[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:45:36 dist-test-slave-t7g5 krb5kdc[29049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:45:36 dist-test-slave-t7g5 krb5kdc[29049](info): set up 2 sockets
Aug 09 00:45:36 dist-test-slave-t7g5 krb5kdc[29049](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 00:45:37.417618 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.005s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:45:37 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:45:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:45:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:45:37.594322 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41207
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:41207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:37.958156 29076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:37.958699 29076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:37.958866 29076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:37.966673 29076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:45:37.966814 29076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:37.966907 29076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:37.966989 29076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:45:37.967052 29076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:45:37.978276 29076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:41207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:37.980420 29076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:37.982506 29076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:38.006071 29084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:38.006153 29085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:38.006186 29088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:38.008899 29076 server_base.cc:1034] running on GCE node
I20260809 00:45:38.010219 29076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:38.012799 29076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:38.014036 29076 hybrid_clock.cc:648] HybridClock initialized: now 1786236338013931 us; error 83 us; skew 500 ppm
I20260809 00:45:38.014619 29076 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:38 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236338, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:38.021061 29076 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:45:38.023936 29076 webserver.cc:460] Webserver started at http://127.28.92.190:38259/ using document root <none> and password file <none>
I20260809 00:45:38.025162 29076 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:38.025352 29076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:38.026083 29076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:38.030676 29076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "b0c57102f3384e369a94dc4882ab6a09"
format_stamp: "Formatted at 2026-08-09 00:45:38 on dist-test-slave-t7g5"
server_key: "56fdc97c5cdf59e4bdb9aa53c944204d"
server_key_iv: "f7336dfabe30e79be3c2c4edd97b7570"
server_key_version: "encryptionkey@0"
I20260809 00:45:38.031575 29076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "b0c57102f3384e369a94dc4882ab6a09"
format_stamp: "Formatted at 2026-08-09 00:45:38 on dist-test-slave-t7g5"
server_key: "56fdc97c5cdf59e4bdb9aa53c944204d"
server_key_iv: "f7336dfabe30e79be3c2c4edd97b7570"
server_key_version: "encryptionkey@0"
I20260809 00:45:38.040376 29076 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
I20260809 00:45:38.046622 29101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:38.048674 29076 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:45:38.049000 29076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "b0c57102f3384e369a94dc4882ab6a09"
format_stamp: "Formatted at 2026-08-09 00:45:38 on dist-test-slave-t7g5"
server_key: "56fdc97c5cdf59e4bdb9aa53c944204d"
server_key_iv: "f7336dfabe30e79be3c2c4edd97b7570"
server_key_version: "encryptionkey@0"
I20260809 00:45:38.049230 29076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:38.071548 29076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:38.076578 29076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:38.076953 29076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:38.101341 29076 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:41207
I20260809 00:45:38.101439 29174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:41207 every 8 connection(s)
I20260809 00:45:38.103961 29076 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:45:38.111867 29175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:38.112098 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29076
I20260809 00:45:38.112524 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:45:38.115732 29042 external_mini_cluster.cc:1428] Setting key 7cd7e35676f573ce97938079e36e0a67
I20260809 00:45:38.131456 29175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09: Bootstrap starting.
I20260809 00:45:38.137917 29175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:38.140290 29175 log.cc:824] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:38.144977 29175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09: No bootstrap required, opened a new log
Aug 09 00:45:38 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236337, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:38.158325 29175 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c57102f3384e369a94dc4882ab6a09" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41207 } }
I20260809 00:45:38.159001 29175 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:38.159230 29175 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0c57102f3384e369a94dc4882ab6a09, State: Initialized, Role: FOLLOWER
I20260809 00:45:38.160609 29175 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c57102f3384e369a94dc4882ab6a09" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41207 } }
I20260809 00:45:38.160955 29175 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:45:38.161269 29175 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:45:38.161506 29175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:38.164633 29175 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c57102f3384e369a94dc4882ab6a09" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41207 } }
I20260809 00:45:38.165740 29175 leader_election.cc:302] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0c57102f3384e369a94dc4882ab6a09; no voters:
I20260809 00:45:38.166836 29175 leader_election.cc:288] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:45:38.167083 29180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:38.169634 29180 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [term 1 LEADER]: Becoming Leader. State: Replica: b0c57102f3384e369a94dc4882ab6a09, State: Running, Role: LEADER
I20260809 00:45:38.170722 29177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:38.123382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58352 (local address 127.28.92.190:41207)
0809 00:45:38.124706 (+ 1324us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:38.124724 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:38.128108 (+ 3384us) server_negotiation.cc:407] Connection header received
0809 00:45:38.139182 (+ 11074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:38.139212 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:38.139989 (+ 777us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:38.140541 (+ 552us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:38.144214 (+ 3673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:38.146750 (+ 2536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:38.148957 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:38.150165 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:38.150409 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:38.158853 (+ 8444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:38.158944 (+ 91us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:38.158995 (+ 51us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:38.159058 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:38.162910 (+ 3852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:38.164032 (+ 1122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:38.164039 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:38.164045 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:38.164296 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:38.164921 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:38.164927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:38.164931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:38.165752 (+ 821us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:38.166134 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:38.167420 (+ 1286us) server_negotiation.cc:299] Negotiation successful
0809 00:45:38.167902 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":869,"thread_start_us":475,"threads_started":1}
I20260809 00:45:38.170538 29180 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c57102f3384e369a94dc4882ab6a09" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41207 } }
I20260809 00:45:38.171476 29175 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:45:38.179592 29183 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0c57102f3384e369a94dc4882ab6a09. Latest consensus state: current_term: 1 leader_uuid: "b0c57102f3384e369a94dc4882ab6a09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c57102f3384e369a94dc4882ab6a09" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41207 } } }
I20260809 00:45:38.179625 29181 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0c57102f3384e369a94dc4882ab6a09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0c57102f3384e369a94dc4882ab6a09" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41207 } } }
I20260809 00:45:38.180063 29183 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:38.180121 29181 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:38.186019 29196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:45:38.195716 29196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:45:38.210736 29196 catalog_manager.cc:1347] Generated new cluster ID: e54b85d6cccf46129f6fd0d9eb122503
I20260809 00:45:38.210871 29196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:45:38.227092 29196 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:45:38.229305 29196 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:45:38.238722 29196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0c57102f3384e369a94dc4882ab6a09: Generated new TSK 0
I20260809 00:45:38.240042 29196 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:45:38.296317 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41207
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:38.655364 29207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:38.655673 29207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:38.655829 29207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:38.663290 29207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:38.663414 29207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:38.663592 29207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:45:38.673774 29207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41207
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:38.675170 29207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:38.676594 29207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:38.693581 29214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:38.693614 29217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:38.693843 29213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:38.694993 29207 server_base.cc:1034] running on GCE node
I20260809 00:45:38.695711 29207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:38.696729 29207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:38.697956 29207 hybrid_clock.cc:648] HybridClock initialized: now 1786236338697894 us; error 43 us; skew 500 ppm
I20260809 00:45:38.698303 29207 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:38 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236338, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:38.701779 29207 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:45:38.703433 29207 webserver.cc:460] Webserver started at http://127.28.92.129:35727/ using document root <none> and password file <none>
I20260809 00:45:38.704149 29207 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:38.704277 29207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:38.704586 29207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:38.707608 29207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "24ee436d5e274dbf96e6f1a891560dfc"
format_stamp: "Formatted at 2026-08-09 00:45:38 on dist-test-slave-t7g5"
server_key: "8fc42d7f01d8629e957579c7c6ab462f"
server_key_iv: "fbe9db18ac26433da7fecb67e920b21f"
server_key_version: "encryptionkey@0"
I20260809 00:45:38.708350 29207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "24ee436d5e274dbf96e6f1a891560dfc"
format_stamp: "Formatted at 2026-08-09 00:45:38 on dist-test-slave-t7g5"
server_key: "8fc42d7f01d8629e957579c7c6ab462f"
server_key_iv: "fbe9db18ac26433da7fecb67e920b21f"
server_key_version: "encryptionkey@0"
I20260809 00:45:38.713601 29207 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:45:38.716998 29227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:38.718364 29207 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:38.718524 29207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "24ee436d5e274dbf96e6f1a891560dfc"
format_stamp: "Formatted at 2026-08-09 00:45:38 on dist-test-slave-t7g5"
server_key: "8fc42d7f01d8629e957579c7c6ab462f"
server_key_iv: "fbe9db18ac26433da7fecb67e920b21f"
server_key_version: "encryptionkey@0"
I20260809 00:45:38.718734 29207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:38.740258 29207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:38.744578 29207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:38.744885 29207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:38.746096 29207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:45:38.747871 29207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:38.747975 29207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:38.748175 29207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:38.748242 29207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:38.785868 29207 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:43761
I20260809 00:45:38.785956 29390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:43761 every 8 connection(s)
I20260809 00:45:38.787168 29207 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:45:38.794715 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29207
I20260809 00:45:38.794965 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:45:38.795599 29042 external_mini_cluster.cc:1428] Setting key a5ee07552bf248b4bf5f53edec816c05
Aug 09 00:45:38 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236338, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:38.809038 29395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:38.790599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:35859 (local address 127.28.92.190:41207)
0809 00:45:38.791093 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:38.791098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:38.792044 (+ 946us) server_negotiation.cc:407] Connection header received
0809 00:45:38.794007 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:38.794013 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:38.794092 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:38.794189 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:38.795840 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:38.796761 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:38.798499 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:38.799109 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:38.799247 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:38.802861 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:38.802867 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:38.802871 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:38.802914 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:38.805691 (+ 2777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:38.806628 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:38.806632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:38.806634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:38.806772 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:38.807240 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:38.807243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:38.807245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:38.807534 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:38.807642 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:38.808605 (+ 963us) server_negotiation.cc:299] Negotiation successful
0809 00:45:38.808772 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":262,"threads_started":1}
I20260809 00:45:38.810643 29396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:38.791137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41207 (local address 127.28.92.129:35859)
0809 00:45:38.791895 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:38.791931 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:38.793727 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:38.794463 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:38.794471 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:38.795058 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:38.795660 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:38.795685 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:38.796928 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:38.796933 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:38.798351 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:38.798366 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:38.799373 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:38.799379 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:38.799612 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:38.800266 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:38.800296 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:38.802622 (+ 2326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:38.805832 (+ 3210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:38.805841 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:38.805860 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:38.806522 (+ 662us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:38.806867 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:38.806872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:38.806876 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:38.807148 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:38.807656 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:38.807664 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:38.808117 (+ 453us) client_negotiation.cc:769] Sending connection context
0809 00:45:38.808534 (+ 417us) client_negotiation.cc:240] Negotiation successful
0809 00:45:38.809074 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":317,"threads_started":1}
I20260809 00:45:38.812353 29391 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41207
I20260809 00:45:38.812793 29391 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:38.813740 29391 heartbeater.cc:511] Master 127.28.92.190:41207 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
I20260809 00:45:38.817786 29129 ts_manager.cc:194] Registered new tserver with Master: 24ee436d5e274dbf96e6f1a891560dfc (127.28.92.129:43761)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
I20260809 00:45:38.820568 29129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:35859
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:45:38.840559 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41207
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:39.207571 29400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:39.207854 29400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:39.208001 29400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:39.215248 29400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:39.215385 29400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:39.215560 29400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:45:39.225980 29400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41207
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:39.227406 29400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:39.228822 29400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:39.241698 29412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:39.241818 29407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:39.241918 29409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:39.243024 29400 server_base.cc:1034] running on GCE node
I20260809 00:45:39.243636 29400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:39.244547 29400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:39.245755 29400 hybrid_clock.cc:648] HybridClock initialized: now 1786236339245712 us; error 32 us; skew 500 ppm
I20260809 00:45:39.246038 29400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:39.249172 29400 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:45:39.250695 29400 webserver.cc:460] Webserver started at http://127.28.92.130:39353/ using document root <none> and password file <none>
I20260809 00:45:39.251349 29400 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:39.251471 29400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:39.251782 29400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:39.254733 29400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "f4721d3292da45d6b078b6c09d93245a"
format_stamp: "Formatted at 2026-08-09 00:45:39 on dist-test-slave-t7g5"
server_key: "35dc0e52ca24b44f3c0d6dff4d4005f5"
server_key_iv: "7dcb0b0806ca323a6939ff3734a0e6fd"
server_key_version: "encryptionkey@0"
I20260809 00:45:39.255491 29400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "f4721d3292da45d6b078b6c09d93245a"
format_stamp: "Formatted at 2026-08-09 00:45:39 on dist-test-slave-t7g5"
server_key: "35dc0e52ca24b44f3c0d6dff4d4005f5"
server_key_iv: "7dcb0b0806ca323a6939ff3734a0e6fd"
server_key_version: "encryptionkey@0"
I20260809 00:45:39.260668 29400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:45:39.264222 29422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:39.265501 29400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:45:39.265683 29400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "f4721d3292da45d6b078b6c09d93245a"
format_stamp: "Formatted at 2026-08-09 00:45:39 on dist-test-slave-t7g5"
server_key: "35dc0e52ca24b44f3c0d6dff4d4005f5"
server_key_iv: "7dcb0b0806ca323a6939ff3734a0e6fd"
server_key_version: "encryptionkey@0"
I20260809 00:45:39.265887 29400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:39.285682 29400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:39.289613 29400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:39.289924 29400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:39.290885 29400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:45:39.292299 29400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:39.292382 29400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:39.292516 29400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:39.292582 29400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:39.328056 29400 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:39937
I20260809 00:45:39.328110 29595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:39937 every 8 connection(s)
I20260809 00:45:39.329375 29400 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:45:39.339035 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29400
I20260809 00:45:39.339212 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:45:39.339637 29042 external_mini_cluster.cc:1428] Setting key 1ff62478e00e9e65162747d5676a2fdf
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:39.349797 29600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:39.332020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:40369 (local address 127.28.92.190:41207)
0809 00:45:39.332464 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:39.332469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:39.333417 (+ 948us) server_negotiation.cc:407] Connection header received
0809 00:45:39.335300 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:39.335306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:39.335383 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:39.335493 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:39.337034 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.337886 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.339456 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.339918 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.340036 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:39.344007 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:39.344012 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:39.344015 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:39.344046 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:39.346635 (+ 2589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:39.347444 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:39.347447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:39.347449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:39.347567 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:39.348007 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:39.348010 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:39.348012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:39.348273 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:39.348380 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:39.349175 (+ 795us) server_negotiation.cc:299] Negotiation successful
0809 00:45:39.349402 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":231,"threads_started":1}
I20260809 00:45:39.350641 29602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:39.332502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41207 (local address 127.28.92.130:40369)
0809 00:45:39.333255 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:39.333306 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:39.335041 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:39.335736 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:39.335744 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:39.336232 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:39.336867 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:39.336885 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.338031 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.338035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:39.339320 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:39.339333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.340165 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.340174 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:39.340412 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:39.341122 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:39.341154 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:39.343760 (+ 2606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:39.346772 (+ 3012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:39.346781 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:39.346795 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:39.347347 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:39.347658 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:39.347663 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:39.347665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:39.347914 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:39.348385 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:39.348392 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:39.348790 (+ 398us) client_negotiation.cc:769] Sending connection context
0809 00:45:39.349119 (+ 329us) client_negotiation.cc:240] Negotiation successful
0809 00:45:39.349505 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":304,"threads_started":1}
I20260809 00:45:39.351956 29596 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41207
I20260809 00:45:39.352234 29596 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:39.352962 29596 heartbeater.cc:511] Master 127.28.92.190:41207 requested a full tablet report, sending...
I20260809 00:45:39.354516 29129 ts_manager.cc:194] Registered new tserver with Master: f4721d3292da45d6b078b6c09d93245a (127.28.92.130:39937)
I20260809 00:45:39.355438 29129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:40369
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:45:39.382205 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41207
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40243
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:39.740540 29605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:39.740861 29605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:39.741024 29605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:39.748654 29605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:39.748788 29605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:39.748960 29605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:45:39.759534 29605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40243
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41207
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:39.760867 29605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:39.762286 29605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:39.775305 29616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:39.775338 29617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:39.775872 29619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:39.776324 29605 server_base.cc:1034] running on GCE node
I20260809 00:45:39.776927 29605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:39.777938 29605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:39.779157 29605 hybrid_clock.cc:648] HybridClock initialized: now 1786236339779107 us; error 45 us; skew 500 ppm
I20260809 00:45:39.779448 29605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:39.782737 29605 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:45:39.784178 29605 webserver.cc:460] Webserver started at http://127.28.92.131:37889/ using document root <none> and password file <none>
I20260809 00:45:39.784854 29605 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:39.784970 29605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:39.785310 29605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:39.788419 29605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "a8b5716f44e243bcad293228696c6a84"
format_stamp: "Formatted at 2026-08-09 00:45:39 on dist-test-slave-t7g5"
server_key: "877ff7611e8d2f9d23a239e65ec35f13"
server_key_iv: "642a2824e0bf6e04e24d0c124149058c"
server_key_version: "encryptionkey@0"
I20260809 00:45:39.789198 29605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "a8b5716f44e243bcad293228696c6a84"
format_stamp: "Formatted at 2026-08-09 00:45:39 on dist-test-slave-t7g5"
server_key: "877ff7611e8d2f9d23a239e65ec35f13"
server_key_iv: "642a2824e0bf6e04e24d0c124149058c"
server_key_version: "encryptionkey@0"
I20260809 00:45:39.794473 29605 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:45:39.798079 29632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:39.799425 29605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 00:45:39.799592 29605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "a8b5716f44e243bcad293228696c6a84"
format_stamp: "Formatted at 2026-08-09 00:45:39 on dist-test-slave-t7g5"
server_key: "877ff7611e8d2f9d23a239e65ec35f13"
server_key_iv: "642a2824e0bf6e04e24d0c124149058c"
server_key_version: "encryptionkey@0"
I20260809 00:45:39.799777 29605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:39.818048 29605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:39.822228 29605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:39.822525 29605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:39.823587 29605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:45:39.824779 29391 heartbeater.cc:503] Master 127.28.92.190:41207 was elected leader, sending a full tablet report...
I20260809 00:45:39.825155 29605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:39.825238 29605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:39.825371 29605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:39.825413 29605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:39.862171 29605 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:39359
I20260809 00:45:39.862217 29818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:39359 every 8 connection(s)
I20260809 00:45:39.863456 29605 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:45:39.869597 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29605
I20260809 00:45:39.869810 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:45:39.870299 29042 external_mini_cluster.cc:1428] Setting key ad55dd4b34a705b7098813cc74e97539
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:39.883960 29824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:39.866318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:46641 (local address 127.28.92.190:41207)
0809 00:45:39.866825 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:39.866830 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:39.867882 (+ 1052us) server_negotiation.cc:407] Connection header received
0809 00:45:39.869918 (+ 2036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:39.869923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:39.870015 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:39.870116 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:39.871842 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.872830 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.874484 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.874901 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.875006 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:39.878463 (+ 3457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:39.878468 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:39.878471 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:39.878503 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:39.880914 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:39.881607 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:39.881611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:39.881613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:39.881785 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:39.882203 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:39.882206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:39.882208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:39.882468 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:39.882609 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:39.883328 (+ 719us) server_negotiation.cc:299] Negotiation successful
0809 00:45:39.883550 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":249,"threads_started":1}
I20260809 00:45:39.884829 29825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:39.866914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41207 (local address 127.28.92.131:46641)
0809 00:45:39.867714 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:39.867755 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:39.869575 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:39.870395 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:39.870406 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:39.870951 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:39.871663 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:39.871691 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.872992 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.872996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:39.874350 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:39.874363 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.875132 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.875141 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:39.875372 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:39.875999 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:39.876032 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:39.878277 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:39.881038 (+ 2761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:39.881047 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:39.881062 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:39.881485 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:39.881887 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:39.881892 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:39.881895 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:39.882087 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:39.882592 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:39.882600 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:39.882909 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 00:45:39.883219 (+ 310us) client_negotiation.cc:240] Negotiation successful
0809 00:45:39.883711 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":366,"threads_started":1}
I20260809 00:45:39.886207 29820 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41207
I20260809 00:45:39.886523 29820 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:39.887378 29820 heartbeater.cc:511] Master 127.28.92.190:41207 requested a full tablet report, sending...
I20260809 00:45:39.888756 29129 ts_manager.cc:194] Registered new tserver with Master: a8b5716f44e243bcad293228696c6a84 (127.28.92.131:39359)
I20260809 00:45:39.889559 29129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:46641
I20260809 00:45:39.898958 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:39.955566 29831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:39.940010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.28.92.129:43761)
0809 00:45:39.940818 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:39.940826 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:39.940854 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:45:39.940916 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:39.940922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:39.941133 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:39.941260 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:39.942938 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.944003 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.945323 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:39.945981 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:39.946075 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:39.950336 (+ 4261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:39.950348 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:39.950363 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:39.950394 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:39.952966 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:39.953614 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:39.953621 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:39.953623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:39.953771 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:39.954097 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:39.954100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:39.954102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:39.954449 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:39.954698 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:39.954978 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 00:45:39.955199 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":466,"threads_started":1}
W20260809 00:45:39.956979 29267 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36860
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 00:45:39 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:40.011439 29831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:39.997359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36866 (local address 127.28.92.129:43761)
0809 00:45:39.997621 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:39.997627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:39.997910 (+ 283us) server_negotiation.cc:407] Connection header received
0809 00:45:39.998076 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:39.998080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:39.998179 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:39.998259 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:39.999707 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.000402 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.001600 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.002050 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.002141 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:40.006314 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:40.006320 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:40.006323 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:40.006360 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:40.009032 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.009613 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.009616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.009618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.009807 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.010167 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.010172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.010174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.010495 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:40.010699 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:40.010916 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 00:45:40.011110 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260809 00:45:40.013489 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29207
I20260809 00:45:40.025715 29831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:40.014588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36870 (local address 127.28.92.129:43761)
0809 00:45:40.014733 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:40.014737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:40.015066 (+ 329us) server_negotiation.cc:407] Connection header received
0809 00:45:40.015184 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:40.015187 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:40.015244 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:40.015317 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:40.016414 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.017124 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.018372 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.018799 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.018890 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:40.020910 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:40.020915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:40.020918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:40.020947 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:40.023598 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.024165 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.024168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.024170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.024301 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.024558 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.024561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.024563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.024798 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:40.024989 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:40.025200 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 00:45:40.025377 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 00:45:40.026621 29384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:40.114202 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29207
I20260809 00:45:40.135682 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29400
Aug 09 00:45:40 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:45:40.150756 29844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:40.136599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56486 (local address 127.28.92.130:39937)
0809 00:45:40.137143 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:40.137151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:40.137176 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:45:40.137250 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:40.137256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:40.137470 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:40.137598 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:40.138717 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.139716 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.140908 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.141456 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.141549 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:40.145373 (+ 3824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:40.145386 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:40.145401 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:40.145435 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:40.148271 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.148862 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.148870 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.148872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.149000 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.149309 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.149312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.149314 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.149718 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:40.149953 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:40.150176 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 00:45:40.150381 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":298,"threads_started":1}
I20260809 00:45:40.152068 29591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:40.239959 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29400
I20260809 00:45:40.261457 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29605
Aug 09 00:45:40 dist-test-slave-t7g5 krb5kdc[29049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:45:40.277314 29849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:40.262544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.28.92.131:39359)
0809 00:45:40.263217 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:40.263224 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:40.263252 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:45:40.263312 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:40.263318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:40.263535 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:40.263686 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:40.264963 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.266047 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.267288 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:40.267845 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:40.267968 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:40.271920 (+ 3952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:40.271931 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:40.271953 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:40.271990 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:40.274601 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.275241 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.275248 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.275251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.275393 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:40.275760 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:40.275763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:40.275765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:40.276110 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:40.276412 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:40.276718 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 00:45:40.276990 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":348,"threads_started":1}
I20260809 00:45:40.278640 29814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:40.360092 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29605
I20260809 00:45:40.383561 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29076
I20260809 00:45:40.384750 29169 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:40.486388 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29076
2026-08-09T00:45:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4317 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:45:40 dist-test-slave-t7g5 krb5kdc[29856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:45:40 dist-test-slave-t7g5 krb5kdc[29856](info): set up 2 sockets
Aug 09 00:45:40 dist-test-slave-t7g5 krb5kdc[29856](info): commencing operation
krb5kdc: starting...
W20260809 00:45:41.666716 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:45:41 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:45:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:45:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:45:41.846891 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43657
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:43657
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:42.164765 29876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:42.165055 29876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:42.165150 29876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:42.172254 29876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:45:42.172358 29876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:42.172410 29876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:42.172472 29876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:45:42.172514 29876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:45:42.182152 29876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:43657
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:42.183421 29876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:42.184691 29876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:42.200637 29883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:42.201025 29887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:42.201071 29882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:42.201582 29876 server_base.cc:1034] running on GCE node
I20260809 00:45:42.202443 29876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:42.203840 29876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:42.205042 29876 hybrid_clock.cc:648] HybridClock initialized: now 1786236342204991 us; error 42 us; skew 500 ppm
I20260809 00:45:42.205360 29876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:42 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236342, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:42.208418 29876 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:45:42.209839 29876 webserver.cc:460] Webserver started at http://127.28.92.190:41407/ using document root <none> and password file <none>
I20260809 00:45:42.210527 29876 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:42.210649 29876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:42.210968 29876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:42.213900 29876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "62271763ea6b4c74a9b5017c198cbce0"
format_stamp: "Formatted at 2026-08-09 00:45:42 on dist-test-slave-t7g5"
server_key: "71450b38f6f130b4febb072059ee0ba4"
server_key_iv: "1b812a6c3bad77ce244ab8d7ab3e4a90"
server_key_version: "encryptionkey@0"
I20260809 00:45:42.214644 29876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "62271763ea6b4c74a9b5017c198cbce0"
format_stamp: "Formatted at 2026-08-09 00:45:42 on dist-test-slave-t7g5"
server_key: "71450b38f6f130b4febb072059ee0ba4"
server_key_iv: "1b812a6c3bad77ce244ab8d7ab3e4a90"
server_key_version: "encryptionkey@0"
I20260809 00:45:42.219713 29876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:45:42.223093 29898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:42.224361 29876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:45:42.224534 29876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "62271763ea6b4c74a9b5017c198cbce0"
format_stamp: "Formatted at 2026-08-09 00:45:42 on dist-test-slave-t7g5"
server_key: "71450b38f6f130b4febb072059ee0ba4"
server_key_iv: "1b812a6c3bad77ce244ab8d7ab3e4a90"
server_key_version: "encryptionkey@0"
I20260809 00:45:42.224720 29876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:42.240448 29876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:42.244311 29876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:42.244578 29876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:42.261569 29876 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:43657
I20260809 00:45:42.261544 29974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:43657 every 8 connection(s)
I20260809 00:45:42.262943 29876 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:45:42.266595 29975 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:42.271988 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29876
I20260809 00:45:42.272194 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:45:42.272832 29042 external_mini_cluster.cc:1428] Setting key 5b6f2112dcdb1a9ed4912d0a73c4218e
I20260809 00:45:42.277623 29975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0: Bootstrap starting.
I20260809 00:45:42.281320 29975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:42.282560 29975 log.cc:824] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:42.285617 29975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0: No bootstrap required, opened a new log
Aug 09 00:45:42 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:42.295118 29975 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62271763ea6b4c74a9b5017c198cbce0" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43657 } }
I20260809 00:45:42.295629 29975 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:42.295743 29975 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62271763ea6b4c74a9b5017c198cbce0, State: Initialized, Role: FOLLOWER
I20260809 00:45:42.296463 29975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62271763ea6b4c74a9b5017c198cbce0" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43657 } }
I20260809 00:45:42.296774 29975 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:45:42.296926 29975 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:45:42.297127 29975 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:42.297530 29980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:42.274808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56950 (local address 127.28.92.190:43657)
0809 00:45:42.275627 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:42.275642 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:42.275691 (+ 49us) server_negotiation.cc:407] Connection header received
0809 00:45:42.278024 (+ 2333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:42.278053 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:42.278536 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:42.278948 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:42.280241 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:42.282195 (+ 1954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:42.283665 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:42.284605 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:42.284781 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:42.288601 (+ 3820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:42.288616 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:42.288638 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:42.288689 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:42.292722 (+ 4033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:42.293432 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:42.293449 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:42.293459 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:42.293719 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:42.294062 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:42.294067 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:42.294070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:42.294862 (+ 792us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:42.295155 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:42.295580 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 00:45:42.296074 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":320,"threads_started":1}
I20260809 00:45:42.299705 29975 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62271763ea6b4c74a9b5017c198cbce0" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43657 } }
I20260809 00:45:42.300211 29975 leader_election.cc:302] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62271763ea6b4c74a9b5017c198cbce0; no voters:
I20260809 00:45:42.300777 29975 leader_election.cc:288] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:45:42.300890 29983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:42.301524 29983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [term 1 LEADER]: Becoming Leader. State: Replica: 62271763ea6b4c74a9b5017c198cbce0, State: Running, Role: LEADER
I20260809 00:45:42.302073 29983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62271763ea6b4c74a9b5017c198cbce0" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43657 } }
I20260809 00:45:42.302775 29975 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:45:42.304738 29987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62271763ea6b4c74a9b5017c198cbce0. Latest consensus state: current_term: 1 leader_uuid: "62271763ea6b4c74a9b5017c198cbce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62271763ea6b4c74a9b5017c198cbce0" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43657 } } }
I20260809 00:45:42.305105 29987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:42.305716 29986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62271763ea6b4c74a9b5017c198cbce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62271763ea6b4c74a9b5017c198cbce0" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43657 } } }
I20260809 00:45:42.305999 29986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:42.306970 29991 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:45:42.312045 29991 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:45:42.321353 29991 catalog_manager.cc:1347] Generated new cluster ID: b0b879c94ba34261bae5d34988942c6a
I20260809 00:45:42.321473 29991 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:45:42.329784 29991 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:45:42.331379 29991 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:45:42.337728 29991 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62271763ea6b4c74a9b5017c198cbce0: Generated new TSK 0
I20260809 00:45:42.338601 29991 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:45:42.389313 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43657
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:42.713519 30015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:42.713830 30015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:42.713973 30015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:42.721381 30015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:42.721499 30015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:42.721674 30015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:45:42.731745 30015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43657
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:42.733112 30015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:42.734553 30015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:42.747834 30022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:42.747915 30023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:42.748077 30025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:42.748975 30015 server_base.cc:1034] running on GCE node
I20260809 00:45:42.749825 30015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:42.750883 30015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:42.752092 30015 hybrid_clock.cc:648] HybridClock initialized: now 1786236342752033 us; error 48 us; skew 500 ppm
I20260809 00:45:42.752396 30015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:42 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236342, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:42.756338 30015 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:45:42.758527 30015 webserver.cc:460] Webserver started at http://127.28.92.129:42141/ using document root <none> and password file <none>
I20260809 00:45:42.759477 30015 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:42.759624 30015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:42.760007 30015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:42.763857 30015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "ce237d9453804469ad800ab312a59f12"
format_stamp: "Formatted at 2026-08-09 00:45:42 on dist-test-slave-t7g5"
server_key: "07194190a32b735685f9af7a5c70e4da"
server_key_iv: "fb8b5267d336fdf78b58463547941dd5"
server_key_version: "encryptionkey@0"
I20260809 00:45:42.764820 30015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "ce237d9453804469ad800ab312a59f12"
format_stamp: "Formatted at 2026-08-09 00:45:42 on dist-test-slave-t7g5"
server_key: "07194190a32b735685f9af7a5c70e4da"
server_key_iv: "fb8b5267d336fdf78b58463547941dd5"
server_key_version: "encryptionkey@0"
I20260809 00:45:42.772032 30015 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260809 00:45:42.776521 30038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:42.778395 30015 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260809 00:45:42.778614 30015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "ce237d9453804469ad800ab312a59f12"
format_stamp: "Formatted at 2026-08-09 00:45:42 on dist-test-slave-t7g5"
server_key: "07194190a32b735685f9af7a5c70e4da"
server_key_iv: "fb8b5267d336fdf78b58463547941dd5"
server_key_version: "encryptionkey@0"
I20260809 00:45:42.778884 30015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:42.796875 30015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:42.801519 30015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:42.801837 30015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:42.802901 30015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:45:42.804337 30015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:42.804418 30015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:42.804554 30015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:42.804626 30015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:42.834409 30015 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40805
I20260809 00:45:42.834458 30213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40805 every 8 connection(s)
I20260809 00:45:42.835702 30015 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:45:42.838390 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30015
I20260809 00:45:42.838610 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:45:42.839248 29042 external_mini_cluster.cc:1428] Setting key 2d336bba8901597cafd38550765acef0
Aug 09 00:45:42 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236342, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:42.856658 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:42.838259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:50249 (local address 127.28.92.190:43657)
0809 00:45:42.838734 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:42.838741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:42.842234 (+ 3493us) server_negotiation.cc:407] Connection header received
0809 00:45:42.842295 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:42.842300 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:42.842384 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:42.842498 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:42.843965 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:42.844910 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:42.846526 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:42.847042 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:42.847156 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:42.850544 (+ 3388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:42.850551 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:42.850555 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:42.850594 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:42.853502 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:42.854329 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:42.854335 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:42.854339 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:42.854487 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:42.854883 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:42.854889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:42.854892 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:42.855261 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:42.855415 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:42.856066 (+ 651us) server_negotiation.cc:299] Negotiation successful
0809 00:45:42.856296 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":234,"threads_started":1}
I20260809 00:45:42.857481 30218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:42.838862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43657 (local address 127.28.92.129:50249)
0809 00:45:42.839665 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:42.839713 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:42.841879 (+ 2166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:42.842713 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:42.842721 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:42.843234 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:42.843788 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:42.843805 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:42.845048 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:42.845052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:42.846378 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:42.846391 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:42.847268 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:42.847276 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:42.847495 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:42.848170 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:42.848192 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:42.850324 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:42.853638 (+ 3314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:42.853646 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:42.853686 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:42.854200 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:42.854577 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:42.854580 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:42.854582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:42.854766 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:42.855367 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:42.855373 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:42.855700 (+ 327us) client_negotiation.cc:769] Sending connection context
0809 00:45:42.855915 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 00:45:42.856299 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":313,"threads_started":1}
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
I20260809 00:45:42.858984 30214 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43657
I20260809 00:45:42.859297 30214 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:42.859987 30214 heartbeater.cc:511] Master 127.28.92.190:43657 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
I20260809 00:45:42.862111 29924 ts_manager.cc:194] Registered new tserver with Master: ce237d9453804469ad800ab312a59f12 (127.28.92.129:40805)
I20260809 00:45:42.863509 29924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:50249
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:45:42.880831 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43657
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:43.198223 30222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:43.198486 30222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:43.198618 30222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:43.205592 30222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:43.205734 30222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:43.205899 30222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:45:43.215334 30222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43657
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:43.216539 30222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:43.217891 30222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:43.230268 30229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:43.230237 30236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:43.230245 30232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:43.231277 30222 server_base.cc:1034] running on GCE node
I20260809 00:45:43.231899 30222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:43.232797 30222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:43.233991 30222 hybrid_clock.cc:648] HybridClock initialized: now 1786236343233937 us; error 42 us; skew 500 ppm
I20260809 00:45:43.234278 30222 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:43 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236343, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:43.240655 30222 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:45:43.242070 30222 webserver.cc:460] Webserver started at http://127.28.92.130:40917/ using document root <none> and password file <none>
I20260809 00:45:43.242801 30222 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:43.242923 30222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:43.243223 30222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:43.246057 30222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "4c129421920043ec9447211e1e6bbe52"
format_stamp: "Formatted at 2026-08-09 00:45:43 on dist-test-slave-t7g5"
server_key: "6032a8cff75b71634ad2cd885916e2e0"
server_key_iv: "fc2efb1549c10b07219dd6c87eae0c85"
server_key_version: "encryptionkey@0"
I20260809 00:45:43.246814 30222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "4c129421920043ec9447211e1e6bbe52"
format_stamp: "Formatted at 2026-08-09 00:45:43 on dist-test-slave-t7g5"
server_key: "6032a8cff75b71634ad2cd885916e2e0"
server_key_iv: "fc2efb1549c10b07219dd6c87eae0c85"
server_key_version: "encryptionkey@0"
I20260809 00:45:43.251708 30222 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:45:43.254999 30251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:43.256230 30222 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:45:43.256384 30222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "4c129421920043ec9447211e1e6bbe52"
format_stamp: "Formatted at 2026-08-09 00:45:43 on dist-test-slave-t7g5"
server_key: "6032a8cff75b71634ad2cd885916e2e0"
server_key_iv: "fc2efb1549c10b07219dd6c87eae0c85"
server_key_version: "encryptionkey@0"
I20260809 00:45:43.256559 30222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:43.292886 30222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:43.296768 30222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:43.297037 30222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:43.298015 30222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:45:43.299324 30222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:43.299415 30222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:43.299537 30222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:43.299592 30222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:43.329487 30222 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:39759
I20260809 00:45:43.329536 30424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:39759 every 8 connection(s)
I20260809 00:45:43.330783 30222 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:45:43.335908 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30222
I20260809 00:45:43.336117 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:45:43.336688 29042 external_mini_cluster.cc:1428] Setting key 4a1882e5dd715b4960f8e7a2733cc8ca
Aug 09 00:45:43 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236343, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:43.351858 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.333207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:45913 (local address 127.28.92.190:43657)
0809 00:45:43.333385 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:43.333389 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:43.334537 (+ 1148us) server_negotiation.cc:407] Connection header received
0809 00:45:43.336621 (+ 2084us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:43.336625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:43.336697 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:43.336794 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:43.338522 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.339398 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.341538 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.341992 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.342084 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.346174 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:43.346179 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:43.346183 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:43.346218 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:43.348692 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:43.349588 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:43.349592 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:43.349594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:43.349753 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:43.350180 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:43.350183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:43.350185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:43.350447 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:43.350568 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:43.351421 (+ 853us) server_negotiation.cc:299] Negotiation successful
0809 00:45:43.351614 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:45:43.353358 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.333724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43657 (local address 127.28.92.130:45913)
0809 00:45:43.334384 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:43.334421 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:43.336332 (+ 1911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:43.337072 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:43.337083 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:43.337818 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:43.338374 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.338395 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.339566 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.339570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.341408 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.341424 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.342197 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.342204 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.342478 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.343270 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:43.343298 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:43.345926 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:43.348833 (+ 2907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:43.348842 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:43.348859 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:43.349477 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:43.349849 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:43.349853 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:43.349857 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:43.350088 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:43.350568 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:43.350576 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:43.351006 (+ 430us) client_negotiation.cc:769] Sending connection context
0809 00:45:43.351324 (+ 318us) client_negotiation.cc:240] Negotiation successful
0809 00:45:43.351890 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":257,"threads_started":1}
I20260809 00:45:43.354838 30425 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43657
I20260809 00:45:43.355139 30425 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
I20260809 00:45:43.355885 30425 heartbeater.cc:511] Master 127.28.92.190:43657 requested a full tablet report, sending...
I20260809 00:45:43.357295 29924 ts_manager.cc:194] Registered new tserver with Master: 4c129421920043ec9447211e1e6bbe52 (127.28.92.130:39759)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
I20260809 00:45:43.358163 29924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:45913
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:45:43.377980 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43657
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38063
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:43.695030 30432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:43.695299 30432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:43.695441 30432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:43.702358 30432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:43.702472 30432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:43.702648 30432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:45:43.711998 30432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38063
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43657
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:43.713128 30432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:43.714421 30432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:43.726437 30441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:43.726554 30444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:43.726521 30442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:43.727859 30432 server_base.cc:1034] running on GCE node
I20260809 00:45:43.728554 30432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:43.729461 30432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:43.730659 30432 hybrid_clock.cc:648] HybridClock initialized: now 1786236343730592 us; error 62 us; skew 500 ppm
I20260809 00:45:43.730953 30432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:43 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236343, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:43.733981 30432 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:45:43.735282 30432 webserver.cc:460] Webserver started at http://127.28.92.131:43247/ using document root <none> and password file <none>
I20260809 00:45:43.735932 30432 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:43.736063 30432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:43.736361 30432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:43.739179 30432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "4933f74432da4104990ba1ea9c40f448"
format_stamp: "Formatted at 2026-08-09 00:45:43 on dist-test-slave-t7g5"
server_key: "307470c592bb9dc236c6ecf989342ced"
server_key_iv: "6f462cceb0829ba82d1021081acda3ea"
server_key_version: "encryptionkey@0"
I20260809 00:45:43.739919 30432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "4933f74432da4104990ba1ea9c40f448"
format_stamp: "Formatted at 2026-08-09 00:45:43 on dist-test-slave-t7g5"
server_key: "307470c592bb9dc236c6ecf989342ced"
server_key_iv: "6f462cceb0829ba82d1021081acda3ea"
server_key_version: "encryptionkey@0"
I20260809 00:45:43.744665 30432 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 00:45:43.747886 30456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:43.749061 30432 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 00:45:43.749203 30432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "4933f74432da4104990ba1ea9c40f448"
format_stamp: "Formatted at 2026-08-09 00:45:43 on dist-test-slave-t7g5"
server_key: "307470c592bb9dc236c6ecf989342ced"
server_key_iv: "6f462cceb0829ba82d1021081acda3ea"
server_key_version: "encryptionkey@0"
I20260809 00:45:43.749372 30432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:43.775141 30432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:43.779383 30432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:43.779657 30432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:43.780608 30432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:45:43.781934 30432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:43.782023 30432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:43.782145 30432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:43.782198 30432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:43.821130 30432 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:38859
I20260809 00:45:43.821180 30633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:38859 every 8 connection(s)
I20260809 00:45:43.822613 30432 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:45:43.832718 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30432
I20260809 00:45:43.832942 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:45:43.833484 29042 external_mini_cluster.cc:1428] Setting key 1a5e5aefb891b7e81cecc6d3a31e06c7
Aug 09 00:45:43 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236343, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:43.847425 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.825396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:52131 (local address 127.28.92.190:43657)
0809 00:45:43.825605 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:43.825612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:43.827073 (+ 1461us) server_negotiation.cc:407] Connection header received
0809 00:45:43.829940 (+ 2867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:43.829945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:43.830024 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:43.830108 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:43.832239 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.833194 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.835539 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.836256 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.836363 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.841238 (+ 4875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:43.841243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:43.841247 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:43.841280 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:43.843969 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:43.844889 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:43.844893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:43.844895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:43.845038 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:43.845498 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:43.845501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:43.845503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:43.845837 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:43.845952 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:43.846859 (+ 907us) server_negotiation.cc:299] Negotiation successful
0809 00:45:43.847054 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 00:45:43.848855 30640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.825908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43657 (local address 127.28.92.131:52131)
0809 00:45:43.826825 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:43.826876 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:43.829565 (+ 2689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:43.830408 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:43.830420 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:43.831233 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:43.832077 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.832103 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.833335 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.833339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.835322 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.835338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.836771 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.836779 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.837060 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.837900 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:43.837931 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:43.841023 (+ 3092us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:43.844117 (+ 3094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:43.844127 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:43.844145 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:43.844782 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:43.845135 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:43.845139 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:43.845143 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:43.845404 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:43.845964 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:43.845974 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:43.846448 (+ 474us) client_negotiation.cc:769] Sending connection context
0809 00:45:43.846772 (+ 324us) client_negotiation.cc:240] Negotiation successful
0809 00:45:43.847381 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":337,"threads_started":1}
I20260809 00:45:43.850668 30637 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43657
I20260809 00:45:43.850991 30637 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:43.851734 30637 heartbeater.cc:511] Master 127.28.92.190:43657 requested a full tablet report, sending...
I20260809 00:45:43.853487 29924 ts_manager.cc:194] Registered new tserver with Master: 4933f74432da4104990ba1ea9c40f448 (127.28.92.131:38859)
I20260809 00:45:43.854828 29924 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:52131
I20260809 00:45:43.861804 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:45:43.866344 30214 heartbeater.cc:503] Master 127.28.92.190:43657 was elected leader, sending a full tablet report...
I20260809 00:45:43.883671 30216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.869723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57412 (local address 127.28.92.190:43657)
0809 00:45:43.869925 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:43.869932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:43.870504 (+ 572us) server_negotiation.cc:407] Connection header received
0809 00:45:43.870643 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:43.870649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:43.870732 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:43.870839 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:43.872594 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.873402 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.874922 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.875413 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.875539 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.878143 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:43.878148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:43.878151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:43.878185 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:43.880901 (+ 2716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:43.881585 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:43.881589 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:43.881592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:43.881806 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:43.882194 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:43.882199 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:43.882203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:43.882550 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:43.882803 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:43.883145 (+ 342us) server_negotiation.cc:299] Negotiation successful
0809 00:45:43.883362 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:45:43.893544 29924 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57412:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:45:43.902747 29924 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:43.946620 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.920720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40805 (local address 127.0.0.1:42402)
0809 00:45:43.934272 (+ 13552us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:43.934312 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:43.934567 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:43.936878 (+ 2311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:43.936888 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:43.936925 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:43.937400 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.937413 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.940536 (+ 3123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.940542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.943362 (+ 2820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.943381 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.945447 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.945455 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.945692 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.945758 (+ 66us) client_negotiation.cc:769] Sending connection context
0809 00:45:43.945879 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 00:45:43.946107 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13292,"mutex_wait_us":26,"thread_start_us":18029,"threads_started":1}
I20260809 00:45:43.947306 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.921808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46594 (local address 127.28.92.130:39759)
0809 00:45:43.937085 (+ 15277us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:43.937094 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:43.937123 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:45:43.937221 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:43.937228 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:43.937448 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:43.937684 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:43.938362 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.940053 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.943506 (+ 3453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.945474 (+ 1968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.945608 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.945855 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:43.946742 (+ 887us) server_negotiation.cc:299] Negotiation successful
0809 00:45:43.946951 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15113,"thread_start_us":16072,"threads_started":1}
I20260809 00:45:43.947858 30663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.921245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:39759 (local address 127.0.0.1:46594)
0809 00:45:43.935171 (+ 13926us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:43.935189 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:43.935305 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:43.937646 (+ 2341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:43.937668 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:43.937695 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:43.938157 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.938168 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.940226 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.940232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.943302 (+ 3070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.943318 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.946018 (+ 2700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.946025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.946225 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.946261 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:45:43.946340 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 00:45:43.946471 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13787,"mutex_wait_us":24,"thread_start_us":12620,"threads_started":1}
I20260809 00:45:43.947953 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.920781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42402 (local address 127.28.92.129:40805)
0809 00:45:43.936065 (+ 15284us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:43.936076 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:43.936115 (+ 39us) server_negotiation.cc:407] Connection header received
0809 00:45:43.936248 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:43.936257 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:43.936544 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:43.938400 (+ 1856us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:43.938677 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.940370 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.943566 (+ 3196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.945133 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.947138 (+ 2005us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.947398 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:43.947463 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 00:45:43.947619 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14952,"thread_start_us":20050,"threads_started":1}
I20260809 00:45:43.952723 30117 tablet_service.cc:1467] Processing CreateTablet for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e (DEFAULT_TABLE table=test-table [id=8ca261107b14402a8af810acf5918894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:43.954701 30117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:43.955681 30326 tablet_service.cc:1467] Processing CreateTablet for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e (DEFAULT_TABLE table=test-table [id=8ca261107b14402a8af810acf5918894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:43.956916 30326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:43.967013 30665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.940654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:38859 (local address 127.0.0.1:41938)
0809 00:45:43.946864 (+ 6210us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:43.946880 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:43.946988 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:43.951071 (+ 4083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:43.951076 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:43.951104 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:43.951559 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.951573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.961054 (+ 9481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.961060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.962991 (+ 1931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:43.963007 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.966207 (+ 3200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.966214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:43.966410 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.966449 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 00:45:43.966516 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 00:45:43.966661 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6127,"thread_start_us":10289,"threads_started":1}
I20260809 00:45:43.968266 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:43.935224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41938 (local address 127.28.92.131:38859)
0809 00:45:43.950219 (+ 14995us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:43.950228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:43.950264 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:45:43.950365 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:43.950373 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:43.950613 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:43.951089 (+ 476us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:43.951782 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.960858 (+ 9076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.963256 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:43.966014 (+ 2758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:43.967407 (+ 1393us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:43.967652 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:43.967724 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 00:45:43.967901 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14819,"thread_start_us":14663,"threads_started":1}
I20260809 00:45:43.972105 30670 tablet_bootstrap.cc:492] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: Bootstrap starting.
I20260809 00:45:43.972275 30535 tablet_service.cc:1467] Processing CreateTablet for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e (DEFAULT_TABLE table=test-table [id=8ca261107b14402a8af810acf5918894]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:43.973809 30535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:43.976238 30670 tablet_bootstrap.cc:654] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:43.977281 30672 tablet_bootstrap.cc:492] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: Bootstrap starting.
I20260809 00:45:43.978797 30670 log.cc:824] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:43.982550 30672 tablet_bootstrap.cc:654] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:43.984011 30672 log.cc:824] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:43.988946 30670 tablet_bootstrap.cc:492] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: No bootstrap required, opened a new log
I20260809 00:45:43.989259 30670 ts_tablet_manager.cc:1397] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.013s
I20260809 00:45:44.001572 30672 tablet_bootstrap.cc:492] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: No bootstrap required, opened a new log
I20260809 00:45:44.001927 30672 ts_tablet_manager.cc:1397] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.000s
I20260809 00:45:44.001979 30670 raft_consensus.cc:348] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.002465 30670 raft_consensus.cc:374] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:44.002574 30670 raft_consensus.cc:729] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce237d9453804469ad800ab312a59f12, State: Initialized, Role: FOLLOWER
I20260809 00:45:44.003319 30670 consensus_queue.cc:260] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.007468 30675 tablet_bootstrap.cc:492] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: Bootstrap starting.
I20260809 00:45:44.012072 30675 tablet_bootstrap.cc:654] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:44.013633 30675 log.cc:824] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:44.015254 30670 ts_tablet_manager.cc:1428] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: Time spent starting tablet: real 0.026s user 0.015s sys 0.009s
I20260809 00:45:44.015183 30672 raft_consensus.cc:348] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.015724 30672 raft_consensus.cc:374] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:44.015866 30672 raft_consensus.cc:729] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c129421920043ec9447211e1e6bbe52, State: Initialized, Role: FOLLOWER
I20260809 00:45:44.016588 30672 consensus_queue.cc:260] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.021625 30675 tablet_bootstrap.cc:492] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: No bootstrap required, opened a new log
I20260809 00:45:44.022009 30675 ts_tablet_manager.cc:1397] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.012s
I20260809 00:45:44.025014 30425 heartbeater.cc:503] Master 127.28.92.190:43657 was elected leader, sending a full tablet report...
I20260809 00:45:44.026398 30672 ts_tablet_manager.cc:1428] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: Time spent starting tablet: real 0.024s user 0.013s sys 0.009s
I20260809 00:45:44.032099 30675 raft_consensus.cc:348] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.032490 30675 raft_consensus.cc:374] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:44.032600 30675 raft_consensus.cc:729] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4933f74432da4104990ba1ea9c40f448, State: Initialized, Role: FOLLOWER
I20260809 00:45:44.033250 30675 consensus_queue.cc:260] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.034411 30637 heartbeater.cc:503] Master 127.28.92.190:43657 was elected leader, sending a full tablet report...
I20260809 00:45:44.035017 30675 ts_tablet_manager.cc:1428] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: Time spent starting tablet: real 0.013s user 0.007s sys 0.005s
I20260809 00:45:44.045791 30679 raft_consensus.cc:482] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:44.046097 30679 raft_consensus.cc:504] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.048450 30679 leader_election.cc:288] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce237d9453804469ad800ab312a59f12 (127.28.92.129:40805), 4933f74432da4104990ba1ea9c40f448 (127.28.92.131:38859)
I20260809 00:45:44.057343 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.048842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:42511 (local address 127.28.92.131:38859)
0809 00:45:44.049082 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.049089 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.049989 (+ 900us) server_negotiation.cc:407] Connection header received
0809 00:45:44.050269 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.050276 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.050356 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.050459 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:44.051150 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.051941 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.055090 (+ 3149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.056481 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.056646 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.056724 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.056972 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.057097 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 00:45:44.057456 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.048755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:38859 (local address 127.28.92.130:42511)
0809 00:45:44.049897 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:44.049913 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:44.050078 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:44.050482 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:44.050486 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:44.050507 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:44.051011 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:44.051021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.052069 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.052075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:44.054910 (+ 2835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:44.054926 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.056686 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.056690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:44.056815 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.056841 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 00:45:44.056921 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:45:44.057058 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1014,"mutex_wait_us":141,"thread_start_us":368,"threads_started":1}
I20260809 00:45:44.059034 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.049100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:40637 (local address 127.28.92.129:40805)
0809 00:45:44.049293 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.049299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.049612 (+ 313us) server_negotiation.cc:407] Connection header received
0809 00:45:44.049946 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.049952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.050030 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.050093 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:44.050926 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.052063 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.056835 (+ 4772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.058163 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.058339 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.058412 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.058658 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.058783 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 00:45:44.059326 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.048648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40805 (local address 127.28.92.130:40637)
0809 00:45:44.049500 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:44.049519 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:44.049761 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:44.050282 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:44.050286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:44.050305 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:44.050757 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:44.050771 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.052192 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.052197 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:44.054910 (+ 2713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:44.054926 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.058364 (+ 3438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.058368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:44.058505 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.058529 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:45:44.058609 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:45:44.058724 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":150,"thread_start_us":888,"threads_started":1}
I20260809 00:45:44.059568 30564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7f905a8a3fa4bbdbe0c9c321b89cc9e" candidate_uuid: "4c129421920043ec9447211e1e6bbe52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4933f74432da4104990ba1ea9c40f448" is_pre_election: true
I20260809 00:45:44.060506 30564 raft_consensus.cc:2454] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c129421920043ec9447211e1e6bbe52 in term 0.
I20260809 00:45:44.061482 30256 leader_election.cc:302] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4933f74432da4104990ba1ea9c40f448, 4c129421920043ec9447211e1e6bbe52; no voters:
I20260809 00:45:44.061906 30679 raft_consensus.cc:2781] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:44.062060 30679 raft_consensus.cc:482] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:44.062165 30679 raft_consensus.cc:3037] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:44.062050 30143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7f905a8a3fa4bbdbe0c9c321b89cc9e" candidate_uuid: "4c129421920043ec9447211e1e6bbe52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce237d9453804469ad800ab312a59f12" is_pre_election: true
I20260809 00:45:44.062693 30143 raft_consensus.cc:2454] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c129421920043ec9447211e1e6bbe52 in term 0.
I20260809 00:45:44.064774 30679 raft_consensus.cc:504] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
I20260809 00:45:44.065404 30679 leader_election.cc:288] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [CANDIDATE]: Term 1 election: Requested vote from peers ce237d9453804469ad800ab312a59f12 (127.28.92.129:40805), 4933f74432da4104990ba1ea9c40f448 (127.28.92.131:38859)
I20260809 00:45:44.065847 30143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7f905a8a3fa4bbdbe0c9c321b89cc9e" candidate_uuid: "4c129421920043ec9447211e1e6bbe52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce237d9453804469ad800ab312a59f12"
I20260809 00:45:44.066025 30143 raft_consensus.cc:3037] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:44.066006 30564 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7f905a8a3fa4bbdbe0c9c321b89cc9e" candidate_uuid: "4c129421920043ec9447211e1e6bbe52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4933f74432da4104990ba1ea9c40f448"
I20260809 00:45:44.066238 30564 raft_consensus.cc:3037] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:44.068204 30143 raft_consensus.cc:2454] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c129421920043ec9447211e1e6bbe52 in term 1.
I20260809 00:45:44.068558 30253 leader_election.cc:302] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c129421920043ec9447211e1e6bbe52, ce237d9453804469ad800ab312a59f12; no voters:
I20260809 00:45:44.068843 30679 raft_consensus.cc:2781] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:44.069350 30679 raft_consensus.cc:686] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [term 1 LEADER]: Becoming Leader. State: Replica: 4c129421920043ec9447211e1e6bbe52, State: Running, Role: LEADER
I20260809 00:45:44.069934 30564 raft_consensus.cc:2454] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c129421920043ec9447211e1e6bbe52 in term 1.
I20260809 00:45:44.069960 30679 consensus_queue.cc:237] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } }
W20260809 00:45:44.074397 30638 tablet.cc:2369] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4933f74432da4104990ba1ea9c40f448: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:45:44.076397 29924 catalog_manager.cc:5495] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c129421920043ec9447211e1e6bbe52 (127.28.92.130). New cstate: current_term: 1 leader_uuid: "4c129421920043ec9447211e1e6bbe52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce237d9453804469ad800ab312a59f12" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c129421920043ec9447211e1e6bbe52" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4933f74432da4104990ba1ea9c40f448" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38859 } health_report { overall_health: UNKNOWN } } }
W20260809 00:45:44.082819 30428 tablet.cc:2369] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P 4c129421920043ec9447211e1e6bbe52: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:45:44.087920 30215 tablet.cc:2369] T e7f905a8a3fa4bbdbe0c9c321b89cc9e P ce237d9453804469ad800ab312a59f12: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:44.118587 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.103560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42412 (local address 127.28.92.129:40805)
0809 00:45:44.103765 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.103772 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.104390 (+ 618us) server_negotiation.cc:407] Connection header received
0809 00:45:44.104527 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.104533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.104614 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.104748 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:44.106374 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.107188 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.108483 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.108977 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.109072 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.113223 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:44.113238 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:44.113254 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:44.113288 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:44.116144 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.116773 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.116779 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.116782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.116911 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.117203 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.117205 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.117208 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.117588 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:44.117885 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.118075 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.118236 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236344, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236344, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:44.171290 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.157049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42422 (local address 127.28.92.129:40805)
0809 00:45:44.157280 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.157287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.157477 (+ 190us) server_negotiation.cc:407] Connection header received
0809 00:45:44.157623 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.157627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.157726 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.157812 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:44.159101 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.159836 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.161255 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.161729 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.161824 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.165769 (+ 3945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:44.165774 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:44.165778 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:44.165811 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:44.168373 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.169136 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.169142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.169163 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.169334 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.169862 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.169868 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.169871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.170180 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:44.170506 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.170728 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.170942 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:44.224946 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.210778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42430 (local address 127.28.92.129:40805)
0809 00:45:44.210960 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.210966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.211451 (+ 485us) server_negotiation.cc:407] Connection header received
0809 00:45:44.211644 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.211650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.211722 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.211808 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:44.213165 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.213975 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.215242 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.215722 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.215835 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.219845 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:44.219850 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:44.219854 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:44.219891 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:44.222319 (+ 2428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.222968 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.222972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.222975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.223109 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.223467 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.223473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.223476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.223797 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:44.224082 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.224331 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.224597 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 00:45:44.227360 30085 tablet_service.cc:2908] Rejecting scan request for tablet e7f905a8a3fa4bbdbe0c9c321b89cc9e: Uninitialized: clean time has not yet been initialized
I20260809 00:45:44.231462 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30015
I20260809 00:45:44.243800 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.232311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42446 (local address 127.28.92.129:40805)
0809 00:45:44.232459 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.232464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.232873 (+ 409us) server_negotiation.cc:407] Connection header received
0809 00:45:44.233030 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.233033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.233103 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.233183 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:44.234504 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.235182 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.236319 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.236703 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.236804 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.239138 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:44.239142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:44.239146 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:44.239177 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:44.241546 (+ 2369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.242225 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.242229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.242231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.242369 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.242650 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.242653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.242655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.242956 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:44.243207 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.243376 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.243549 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 00:45:44.244421 30207 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:44.333361 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30015
I20260809 00:45:44.359678 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30222
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:45:44.373263 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.360447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46608 (local address 127.28.92.130:39759)
0809 00:45:44.360634 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.360640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.360684 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:45:44.360900 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.360905 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.360985 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.361068 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:44.362237 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.362945 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.364107 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.364491 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.364626 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.368368 (+ 3742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:44.368380 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:44.368397 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:44.368428 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:44.371054 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.371652 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.371658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.371660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.371792 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.372085 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.372088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.372090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.372424 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:44.372632 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.372828 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.373011 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:45:44.373948 30420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:44.462741 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30222
I20260809 00:45:44.483717 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30432
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[29856](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236344, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:45:44.498593 30668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:44.484504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.28.92.131:38859)
0809 00:45:44.484680 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:44.484686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:44.484721 (+ 35us) server_negotiation.cc:407] Connection header received
0809 00:45:44.484900 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:44.484904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:44.484976 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:44.485056 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:44.486372 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.487159 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.488515 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:44.488919 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:44.489040 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:44.493269 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:44.493285 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:44.493303 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:44.493343 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:44.496134 (+ 2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.496771 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.496778 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.496781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.496922 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:44.497223 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:44.497226 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:44.497228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:44.497601 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:44.497902 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:44.498149 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 00:45:44.498329 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:45:44.499243 30625 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:44.585819 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30432
I20260809 00:45:44.607679 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29876
I20260809 00:45:44.608803 29967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:44.714711 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29876
2026-08-09T00:45:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4227 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[30720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[30720](info): set up 2 sockets
Aug 09 00:45:44 dist-test-slave-t7g5 krb5kdc[30720](info): commencing operation
krb5kdc: starting...
W20260809 00:45:45.913831 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.005s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:45:46 dist-test-slave-t7g5 krb5kdc[30720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:45:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:45:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:45:46.102880 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35725
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:35725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:46.423471 30742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:46.423779 30742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:46.423889 30742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:46.431020 30742 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:45:46.431135 30742 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 00:45:46.431176 30742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:46.431237 30742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:46.431286 30742 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:45:46.431347 30742 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:45:46.441644 30742 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:35725
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:46.443032 30742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:46.444360 30742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:46.455991 30756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:46.456214 30752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:46.456566 30753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:46.457059 30742 server_base.cc:1034] running on GCE node
I20260809 00:45:46.457863 30742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:46.459229 30742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:46.460454 30742 hybrid_clock.cc:648] HybridClock initialized: now 1786236346460391 us; error 34 us; skew 500 ppm
I20260809 00:45:46.460774 30742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:46 dist-test-slave-t7g5 krb5kdc[30720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236346, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:46.463837 30742 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:45:46.465282 30742 webserver.cc:460] Webserver started at http://127.28.92.190:36805/ using document root <none> and password file <none>
I20260809 00:45:46.466025 30742 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:46.466120 30742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:46.466454 30742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:46.469409 30742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "cf5e42331a414b348e5dd4066fd28273"
format_stamp: "Formatted at 2026-08-09 00:45:46 on dist-test-slave-t7g5"
server_key: "8ede043edad6b4a2e19b2892dff1d8e4"
server_key_iv: "1701cffc28b3dc473ff3e1fa3db8cb0f"
server_key_version: "encryptionkey@0"
I20260809 00:45:46.470219 30742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "cf5e42331a414b348e5dd4066fd28273"
format_stamp: "Formatted at 2026-08-09 00:45:46 on dist-test-slave-t7g5"
server_key: "8ede043edad6b4a2e19b2892dff1d8e4"
server_key_iv: "1701cffc28b3dc473ff3e1fa3db8cb0f"
server_key_version: "encryptionkey@0"
I20260809 00:45:46.475276 30742 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:45:46.478708 30767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:46.479966 30742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:45:46.480123 30742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "cf5e42331a414b348e5dd4066fd28273"
format_stamp: "Formatted at 2026-08-09 00:45:46 on dist-test-slave-t7g5"
server_key: "8ede043edad6b4a2e19b2892dff1d8e4"
server_key_iv: "1701cffc28b3dc473ff3e1fa3db8cb0f"
server_key_version: "encryptionkey@0"
I20260809 00:45:46.480333 30742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:46.501194 30742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:46.505540 30742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:46.505833 30742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:46.525192 30742 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:35725
I20260809 00:45:46.525213 30861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:35725 every 8 connection(s)
I20260809 00:45:46.526615 30742 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:45:46.529218 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30742
I20260809 00:45:46.529436 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:45:46.530174 29042 external_mini_cluster.cc:1428] Setting key a4f42e14f0fc9e88cbb102b8f5dbf2ce
I20260809 00:45:46.530541 30862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:46.544438 30862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: Bootstrap starting.
Aug 09 00:45:46 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:46.548228 30862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:46.549549 30862 log.cc:824] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:46.552862 30862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: No bootstrap required, opened a new log
I20260809 00:45:46.554173 30865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:46.532079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51346 (local address 127.28.92.190:35725)
0809 00:45:46.532835 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:46.532846 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:46.532887 (+ 41us) server_negotiation.cc:407] Connection header received
0809 00:45:46.535067 (+ 2180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:46.535091 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:46.535506 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:46.535843 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:46.537558 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:46.538936 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:46.540616 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:46.541320 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:46.541456 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:46.546129 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:46.546140 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:46.546159 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:46.546207 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:46.549915 (+ 3708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:46.550723 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:46.550729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:46.550735 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:46.550886 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:46.551233 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:46.551239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:46.551242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:46.551902 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:46.552189 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:46.552460 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 00:45:46.552869 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":346,"threads_started":1}
I20260809 00:45:46.561048 30862 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf5e42331a414b348e5dd4066fd28273" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35725 } }
I20260809 00:45:46.561353 30862 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:46.561429 30862 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf5e42331a414b348e5dd4066fd28273, State: Initialized, Role: FOLLOWER
I20260809 00:45:46.561949 30862 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf5e42331a414b348e5dd4066fd28273" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35725 } }
I20260809 00:45:46.562152 30862 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:45:46.562245 30862 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:45:46.562366 30862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:46.564535 30862 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf5e42331a414b348e5dd4066fd28273" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35725 } }
I20260809 00:45:46.564963 30862 leader_election.cc:302] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf5e42331a414b348e5dd4066fd28273; no voters:
I20260809 00:45:46.565452 30862 leader_election.cc:288] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:45:46.565577 30867 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:46.566244 30867 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [term 1 LEADER]: Becoming Leader. State: Replica: cf5e42331a414b348e5dd4066fd28273, State: Running, Role: LEADER
I20260809 00:45:46.566766 30867 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf5e42331a414b348e5dd4066fd28273" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35725 } }
I20260809 00:45:46.567346 30862 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:45:46.569422 30868 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf5e42331a414b348e5dd4066fd28273" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf5e42331a414b348e5dd4066fd28273" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35725 } } }
I20260809 00:45:46.569864 30868 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:46.569767 30870 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf5e42331a414b348e5dd4066fd28273. Latest consensus state: current_term: 1 leader_uuid: "cf5e42331a414b348e5dd4066fd28273" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf5e42331a414b348e5dd4066fd28273" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35725 } } }
I20260809 00:45:46.570097 30870 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:46.572211 30878 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:45:46.576956 30878 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:45:46.584954 30878 catalog_manager.cc:1347] Generated new cluster ID: 555ca1baf0514fc588bd6368208ccc3d
I20260809 00:45:46.585083 30878 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:45:46.612124 30878 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:45:46.613433 30878 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:45:46.618986 30878 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: Generated new TSK 0
I20260809 00:45:46.619797 30878 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:45:46.671000 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35725
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:46.985540 30901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:46.985870 30901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:46.986016 30901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:46.993161 30901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:46.993268 30901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:46.993392 30901 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:45:46.993500 30901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:45:47.003345 30901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:35725
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:47.004683 30901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:47.006106 30901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:47.019066 30909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:47.019129 30907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:47.019326 30912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:47.020138 30901 server_base.cc:1034] running on GCE node
I20260809 00:45:47.020740 30901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:47.021646 30901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:47.022902 30901 hybrid_clock.cc:648] HybridClock initialized: now 1786236347022835 us; error 44 us; skew 500 ppm
I20260809 00:45:47.023191 30901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:47 dist-test-slave-t7g5 krb5kdc[30720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236347, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:47.026232 30901 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:45:47.028071 30901 webserver.cc:460] Webserver started at http://127.28.92.129:35035/ using document root <none> and password file <none>
I20260809 00:45:47.028760 30901 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:47.028864 30901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:47.029167 30901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:47.032001 30901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "e998fc62fe4e4adfbe24b589443c66b9"
format_stamp: "Formatted at 2026-08-09 00:45:47 on dist-test-slave-t7g5"
server_key: "b3378d063189443b73552f50b3738868"
server_key_iv: "78f65062cd6b9299d08f3906edb963ba"
server_key_version: "encryptionkey@0"
I20260809 00:45:47.032764 30901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "e998fc62fe4e4adfbe24b589443c66b9"
format_stamp: "Formatted at 2026-08-09 00:45:47 on dist-test-slave-t7g5"
server_key: "b3378d063189443b73552f50b3738868"
server_key_iv: "78f65062cd6b9299d08f3906edb963ba"
server_key_version: "encryptionkey@0"
I20260809 00:45:47.037708 30901 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:45:47.040973 30922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:47.042253 30901 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:47.042402 30901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "e998fc62fe4e4adfbe24b589443c66b9"
format_stamp: "Formatted at 2026-08-09 00:45:47 on dist-test-slave-t7g5"
server_key: "b3378d063189443b73552f50b3738868"
server_key_iv: "78f65062cd6b9299d08f3906edb963ba"
server_key_version: "encryptionkey@0"
I20260809 00:45:47.042605 30901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:47.061756 30901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:47.066344 30901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:47.066603 30901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:47.069512 30901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:47.069597 30901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:47.069741 30901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:47.069796 30901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:45:47 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236347, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:47.095466 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.070286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54201 (local address 127.28.92.190:35725)
0809 00:45:47.070734 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:47.070741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:47.071947 (+ 1206us) server_negotiation.cc:407] Connection header received
0809 00:45:47.074240 (+ 2293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:47.074247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:47.074331 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:47.074407 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:47.076869 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.078042 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.081003 (+ 2961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.081631 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.081794 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.087668 (+ 5874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:47.087676 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:47.087681 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:47.087731 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:47.091421 (+ 3690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.092517 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.092521 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.092524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.092663 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.093277 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.093282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.093285 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.093619 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:47.093784 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:47.094852 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0809 00:45:47.095098 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":223,"threads_started":1}
I20260809 00:45:47.096994 30939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.070925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.28.92.129:54201)
0809 00:45:47.071787 (+ 862us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:47.071834 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:47.073869 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:47.074968 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:47.074981 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:47.075782 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:47.076649 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.076678 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.078326 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.078332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.080822 (+ 2490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.080841 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.081926 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.081935 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.082267 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.083279 (+ 1012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:47.083320 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:47.087286 (+ 3966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:47.091614 (+ 4328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.091627 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.091650 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.092326 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.092824 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.092829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.092832 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.093107 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.093893 (+ 786us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:47.093901 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:47.094417 (+ 516us) client_negotiation.cc:769] Sending connection context
0809 00:45:47.094766 (+ 349us) client_negotiation.cc:240] Negotiation successful
0809 00:45:47.095342 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":346,"threads_started":1}
I20260809 00:45:47.109323 30901 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:38535
I20260809 00:45:47.109360 31119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:38535 every 8 connection(s)
I20260809 00:45:47.110770 30901 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:45:47.113003 31121 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35725
I20260809 00:45:47.113216 31121 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:47.113907 31121 heartbeater.cc:511] Master 127.28.92.190:35725 requested a full tablet report, sending...
I20260809 00:45:47.116218 30798 ts_manager.cc:194] Registered new tserver with Master: e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535)
I20260809 00:45:47.117532 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.104075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:60109 (local address 127.28.92.190:35725)
0809 00:45:47.104263 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:47.104269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:47.104990 (+ 721us) server_negotiation.cc:407] Connection header received
0809 00:45:47.105279 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:47.105283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:47.105351 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:47.105443 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:47.107047 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.107960 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.109508 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.110010 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.110125 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.112202 (+ 2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:47.112210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:47.112214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:47.112254 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:47.114918 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.115673 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.115680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.115682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.115825 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.116196 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.116199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.116204 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.116565 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:47.116673 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:47.117098 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 00:45:47.117271 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 00:45:47.117885 31101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.104185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.28.92.129:60109)
0809 00:45:47.104867 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:47.104889 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:47.105135 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:47.105679 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:47.105685 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:47.106358 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:47.106865 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.106882 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.108097 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.108103 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.109357 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.109371 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.110197 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.110204 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.110367 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.110963 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:47.110981 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:47.111964 (+ 983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:47.115039 (+ 3075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.115045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.115048 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.115565 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.115924 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.115929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.115932 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.116107 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.116672 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:47.116677 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:47.116872 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 00:45:47.117024 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 00:45:47.117340 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":350,"threads_started":1}
I20260809 00:45:47.118275 30798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:54201
I20260809 00:45:47.118424 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30901
I20260809 00:45:47.118647 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:45:47.119504 29042 external_mini_cluster.cc:1428] Setting key 991da72c1ba36e11597f057a9959a242
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:45:47.160457 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35725
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:47.476553 31129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:47.476814 31129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:47.476918 31129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:47.484086 31129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:47.484222 31129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:47.484345 31129 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:45:47.484453 31129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:45:47.494267 31129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:35725
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:47.495575 31129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:47.496979 31129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:47.510142 31138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:47.510123 31139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:47.510387 31144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:47.511081 31129 server_base.cc:1034] running on GCE node
I20260809 00:45:47.511758 31129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:47.512722 31129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:47.513942 31129 hybrid_clock.cc:648] HybridClock initialized: now 1786236347513868 us; error 47 us; skew 500 ppm
I20260809 00:45:47.514279 31129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:47 dist-test-slave-t7g5 krb5kdc[30720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236347, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:47.517638 31129 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:45:47.519160 31129 webserver.cc:460] Webserver started at http://127.28.92.130:45529/ using document root <none> and password file <none>
I20260809 00:45:47.519884 31129 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:47.519977 31129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:47.520287 31129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:47.523396 31129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2"
format_stamp: "Formatted at 2026-08-09 00:45:47 on dist-test-slave-t7g5"
server_key: "9336e37b2c4bd7b3c2a1718a03474f93"
server_key_iv: "2e158d4f58127dec6e898300331bba91"
server_key_version: "encryptionkey@0"
I20260809 00:45:47.524183 31129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2"
format_stamp: "Formatted at 2026-08-09 00:45:47 on dist-test-slave-t7g5"
server_key: "9336e37b2c4bd7b3c2a1718a03474f93"
server_key_iv: "2e158d4f58127dec6e898300331bba91"
server_key_version: "encryptionkey@0"
I20260809 00:45:47.529783 31129 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:45:47.533411 31161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:47.535046 31129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:47.535210 31129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2"
format_stamp: "Formatted at 2026-08-09 00:45:47 on dist-test-slave-t7g5"
server_key: "9336e37b2c4bd7b3c2a1718a03474f93"
server_key_iv: "2e158d4f58127dec6e898300331bba91"
server_key_version: "encryptionkey@0"
I20260809 00:45:47.535421 31129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:47.560858 31129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:47.564693 31129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:47.564987 31129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:47.567675 31129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:47.567770 31129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:47.567906 31129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:47.567988 31129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:45:47 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236347, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:47.589836 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.568162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:43261 (local address 127.28.92.190:35725)
0809 00:45:47.568359 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:47.568365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:47.569905 (+ 1540us) server_negotiation.cc:407] Connection header received
0809 00:45:47.572002 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:47.572009 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:47.572101 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:47.572222 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:47.574468 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.575401 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.577832 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.578445 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.578579 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.583454 (+ 4875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:47.583460 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:47.583466 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:47.583508 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:47.586707 (+ 3199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.587457 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.587463 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.587467 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.587595 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.588041 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.588045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.588047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.588340 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:47.588494 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:47.589222 (+ 728us) server_negotiation.cc:299] Negotiation successful
0809 00:45:47.589455 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 00:45:47.590979 31173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.568787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.28.92.130:43261)
0809 00:45:47.569722 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:47.569779 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:47.571653 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:47.572600 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:47.572608 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:47.573373 (+ 765us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:47.574276 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.574297 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.575670 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.575679 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.577624 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.577637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.578899 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.578906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.579152 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.579942 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:47.579978 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:47.583134 (+ 3156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:47.586852 (+ 3718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.586860 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.586874 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.587324 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.587702 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.587706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.587708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.587917 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.588486 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:47.588495 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:47.588851 (+ 356us) client_negotiation.cc:769] Sending connection context
0809 00:45:47.589098 (+ 247us) client_negotiation.cc:240] Negotiation successful
0809 00:45:47.589694 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":371,"threads_started":1}
I20260809 00:45:47.612098 31262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.598262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.28.92.130:44857)
0809 00:45:47.598855 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:47.598871 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:47.599016 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:47.599322 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:47.599326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:47.599861 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:47.600179 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.600190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.601166 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.601171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.602392 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:47.602405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.603672 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.603682 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:47.603872 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.604509 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:47.604535 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:47.605456 (+ 921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:47.609005 (+ 3549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.609011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.609015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.609403 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.609813 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:47.609818 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:47.609822 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:47.609988 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:47.610817 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:47.610822 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:47.611060 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 00:45:47.611256 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 00:45:47.611635 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":318,"threads_started":1}
I20260809 00:45:47.613313 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:47.597854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:44857 (local address 127.28.92.190:35725)
0809 00:45:47.598016 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:47.598021 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:47.598952 (+ 931us) server_negotiation.cc:407] Connection header received
0809 00:45:47.599134 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:47.599138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:47.599199 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:47.599282 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:47.600319 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.601031 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.602611 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:47.603236 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:47.603369 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:47.605742 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:47.605747 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:47.605751 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:47.605782 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:47.608877 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.609516 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.609521 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.609525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.609702 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:47.610121 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:47.610127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:47.610131 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:47.610648 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:47.612590 (+ 1942us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:47.612726 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 00:45:47.612967 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 00:45:47.624992 31129 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:42633
I20260809 00:45:47.625023 31342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:42633 every 8 connection(s)
I20260809 00:45:47.626176 31129 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:45:47.627648 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31129
I20260809 00:45:47.627843 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:45:47.628144 31343 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35725
I20260809 00:45:47.628353 31343 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:47.628373 29042 external_mini_cluster.cc:1428] Setting key b91cc9510661fd99e88b5ba0296d65b9
I20260809 00:45:47.629066 31343 heartbeater.cc:511] Master 127.28.92.190:35725 requested a full tablet report, sending...
I20260809 00:45:47.630467 30796 ts_manager.cc:194] Registered new tserver with Master: 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633)
I20260809 00:45:47.631295 30796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:43261
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:45:47.668864 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35725
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:47.991258 31348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:47.991595 31348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:47.991745 31348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:47.999261 31348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:47.999394 31348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:47.999539 31348 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:45:47.999657 31348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:45:48.009807 31348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:35725
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:48.011214 31348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:48.012637 31348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:48.026027 31362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:48.026101 31360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:48.026103 31364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:48.026849 31348 server_base.cc:1034] running on GCE node
I20260809 00:45:48.027516 31348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:48.028450 31348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:48.029695 31348 hybrid_clock.cc:648] HybridClock initialized: now 1786236348029603 us; error 49 us; skew 500 ppm
I20260809 00:45:48.030001 31348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:48 dist-test-slave-t7g5 krb5kdc[30720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:48.033166 31348 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:45:48.034596 31348 webserver.cc:460] Webserver started at http://127.28.92.131:42991/ using document root <none> and password file <none>
I20260809 00:45:48.035319 31348 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:48.035413 31348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:48.035741 31348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:48.038740 31348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "f02a95427f7a481cb00268650609de16"
format_stamp: "Formatted at 2026-08-09 00:45:48 on dist-test-slave-t7g5"
server_key: "44d953288dd30c1f4ff4f7258002b6c5"
server_key_iv: "77d9dcdd9868046058e58ac77eb8b2a1"
server_key_version: "encryptionkey@0"
I20260809 00:45:48.039618 31348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "f02a95427f7a481cb00268650609de16"
format_stamp: "Formatted at 2026-08-09 00:45:48 on dist-test-slave-t7g5"
server_key: "44d953288dd30c1f4ff4f7258002b6c5"
server_key_iv: "77d9dcdd9868046058e58ac77eb8b2a1"
server_key_version: "encryptionkey@0"
I20260809 00:45:48.044795 31348 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 00:45:48.048333 31380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:48.049624 31348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 00:45:48.049835 31348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "f02a95427f7a481cb00268650609de16"
format_stamp: "Formatted at 2026-08-09 00:45:48 on dist-test-slave-t7g5"
server_key: "44d953288dd30c1f4ff4f7258002b6c5"
server_key_iv: "77d9dcdd9868046058e58ac77eb8b2a1"
server_key_version: "encryptionkey@0"
I20260809 00:45:48.050051 31348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:48.061354 31348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:48.065136 31348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:48.065426 31348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:48.068171 31348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:48.068274 31348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:48.068436 31348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:48.068512 31348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:45:48 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:48.090975 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.068607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:60863 (local address 127.28.92.190:35725)
0809 00:45:48.068787 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.068794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.070263 (+ 1469us) server_negotiation.cc:407] Connection header received
0809 00:45:48.072290 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.072296 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.072391 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.072488 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:48.074445 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.075508 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.077995 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.078541 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.078660 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.083368 (+ 4708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:48.083376 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:48.083380 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:48.083425 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:48.086871 (+ 3446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.087846 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.087853 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.087856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.088044 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.088646 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.088652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.088655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.089033 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:48.089186 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.090324 (+ 1138us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.090594 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 00:45:48.092033 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.069266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.28.92.131:60863)
0809 00:45:48.070095 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.070141 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.072004 (+ 1863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.072721 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.072729 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.073322 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:48.074215 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.074247 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.075685 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.075689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.077834 (+ 2145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.077849 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.078788 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.078797 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.079101 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.079845 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:48.079884 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:48.083099 (+ 3215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:48.087053 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:48.087063 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:48.087086 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:48.087713 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:48.088201 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:48.088206 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:48.088209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:48.088482 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:48.089275 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:48.089285 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:48.089856 (+ 571us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.090168 (+ 312us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.090763 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":390,"threads_started":1}
I20260809 00:45:48.112766 31348 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:32855
I20260809 00:45:48.112977 31569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:32855 every 8 connection(s)
I20260809 00:45:48.114408 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.097807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:57005 (local address 127.28.92.190:35725)
0809 00:45:48.098035 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.098041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.098953 (+ 912us) server_negotiation.cc:407] Connection header received
0809 00:45:48.099175 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.099182 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.099272 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.099377 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:48.100748 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.101892 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.103841 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.104495 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.104636 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.107346 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:48.107351 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:48.107356 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:48.107399 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:48.111027 (+ 3628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.112095 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.112101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.112105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.112287 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.112782 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.112787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.112790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.113163 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:48.113321 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.113819 (+ 498us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.114073 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 00:45:48.114483 31507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.098151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.28.92.131:57005)
0809 00:45:48.098843 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.098872 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.099033 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.099600 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.099605 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.100287 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:48.100583 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.100594 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.102045 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.102051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.103682 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.103695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.104709 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.104719 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.104930 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.105831 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:48.105858 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:48.107152 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:48.111217 (+ 4065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:48.111222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:48.111226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:48.111917 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:48.112453 (+ 536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:48.112459 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:48.112463 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:48.112638 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:48.113282 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:48.113287 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:48.113498 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.113648 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.114033 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":318,"threads_started":1}
I20260809 00:45:48.114604 31348 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:45:48.116894 31570 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35725
I20260809 00:45:48.117132 31570 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:48.117930 31570 heartbeater.cc:511] Master 127.28.92.190:35725 requested a full tablet report, sending...
I20260809 00:45:48.118012 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31348
I20260809 00:45:48.118237 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:45:48.118810 29042 external_mini_cluster.cc:1428] Setting key 6ef37902a7f9263565dedd0faa289cef
I20260809 00:45:48.119640 30796 ts_manager.cc:194] Registered new tserver with Master: f02a95427f7a481cb00268650609de16 (127.28.92.131:32855)
I20260809 00:45:48.120648 30796 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:60863
I20260809 00:45:48.121737 31121 heartbeater.cc:503] Master 127.28.92.190:35725 was elected leader, sending a full tablet report...
I20260809 00:45:48.121829 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 00:45:48 dist-test-slave-t7g5 krb5kdc[30720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 00:45:48 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:48.168234 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.155417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51362 (local address 127.28.92.190:35725)
0809 00:45:48.155656 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.155662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.155879 (+ 217us) server_negotiation.cc:407] Connection header received
0809 00:45:48.156044 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.156048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.156115 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.156200 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:48.157530 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.158319 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.159514 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.159933 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.160024 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.163609 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:48.163614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:48.163618 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:48.163651 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:48.165969 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.166523 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.166526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.166529 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.166644 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.166922 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.166924 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.166926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.167234 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:48.167419 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.167632 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.167839 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 00:45:48.172327 30798 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:45:48.179140 30798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:48.210486 31589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.196153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:32855 (local address 127.0.0.1:59874)
0809 00:45:48.197184 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.197226 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.197425 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.202808 (+ 5383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.202816 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.202849 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.203420 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.203435 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.205157 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.205163 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.207396 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.207412 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.209543 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.209548 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.209735 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.209777 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.209898 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.210103 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":965,"threads_started":1}
I20260809 00:45:48.210469 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.196856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59874 (local address 127.28.92.131:32855)
0809 00:45:48.202190 (+ 5334us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.202198 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.202234 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:45:48.202342 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.202351 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.202578 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.202763 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.203644 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.205038 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.207594 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.209047 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.209153 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.209364 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.209983 (+ 619us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.210149 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5152,"thread_start_us":4986,"threads_started":1}
I20260809 00:45:48.210606 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.198448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60090 (local address 127.28.92.130:42633)
0809 00:45:48.198979 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.198987 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.203692 (+ 4705us) server_negotiation.cc:407] Connection header received
0809 00:45:48.203857 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.203865 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.204113 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.204316 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.204833 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.206248 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.208349 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.209222 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.209356 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.209560 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.210140 (+ 580us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.210312 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":255,"threads_started":1}
I20260809 00:45:48.211355 31592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.198069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:42633 (local address 127.0.0.1:60090)
0809 00:45:48.203540 (+ 5471us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.203559 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.203688 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.204316 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.204321 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.204346 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.204688 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.204699 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.206378 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.206384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.208200 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.208212 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.209731 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.209741 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.209906 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.209953 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.210793 (+ 840us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.210961 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5351,"mutex_wait_us":19,"thread_start_us":1296,"threads_started":1}
I20260809 00:45:48.213896 31594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.196403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:38535 (local address 127.0.0.1:33338)
0809 00:45:48.199631 (+ 3228us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.199650 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.199748 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.206699 (+ 6951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.206704 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.206734 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.207232 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.207246 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.209210 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.209215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.211301 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.211317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.213110 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.213118 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.213286 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.213318 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.213413 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.213533 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3116,"mutex_wait_us":26,"thread_start_us":6762,"threads_started":1}
I20260809 00:45:48.213927 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.198180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33338 (local address 127.28.92.129:38535)
0809 00:45:48.206107 (+ 7927us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.206115 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.206142 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:45:48.206237 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.206244 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.206468 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.207443 (+ 975us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.207648 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.209070 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.211466 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.212910 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.213068 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.213260 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.213463 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.213617 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7766,"thread_start_us":7628,"threads_started":1}
I20260809 00:45:48.214933 31234 tablet_service.cc:1467] Processing CreateTablet for tablet 4b62520beda94504acee2ecad3b7799f (DEFAULT_TABLE table=test-table [id=af5bd5a8e4ec4af4bc47936122985a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:48.214928 31450 tablet_service.cc:1467] Processing CreateTablet for tablet 4b62520beda94504acee2ecad3b7799f (DEFAULT_TABLE table=test-table [id=af5bd5a8e4ec4af4bc47936122985a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:48.216142 31450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b62520beda94504acee2ecad3b7799f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.216146 31234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b62520beda94504acee2ecad3b7799f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.221199 31015 tablet_service.cc:1467] Processing CreateTablet for tablet 4b62520beda94504acee2ecad3b7799f (DEFAULT_TABLE table=test-table [id=af5bd5a8e4ec4af4bc47936122985a24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:48.222587 31015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b62520beda94504acee2ecad3b7799f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.227597 31598 tablet_bootstrap.cc:492] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Bootstrap starting.
I20260809 00:45:48.230078 31600 tablet_bootstrap.cc:492] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Bootstrap starting.
I20260809 00:45:48.231061 31598 tablet_bootstrap.cc:654] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.232324 31598 log.cc:824] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:48.233253 31600 tablet_bootstrap.cc:654] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.234476 31600 log.cc:824] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:48.235487 31598 tablet_bootstrap.cc:492] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: No bootstrap required, opened a new log
I20260809 00:45:48.235808 31598 ts_tablet_manager.cc:1397] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260809 00:45:48.236392 31605 tablet_bootstrap.cc:492] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Bootstrap starting.
I20260809 00:45:48.237325 31600 tablet_bootstrap.cc:492] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: No bootstrap required, opened a new log
I20260809 00:45:48.237603 31600 ts_tablet_manager.cc:1397] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 00:45:48.239837 31605 tablet_bootstrap.cc:654] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.241093 31605 log.cc:824] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:48.243625 31598 raft_consensus.cc:348] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.243961 31598 raft_consensus.cc:374] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.244088 31598 raft_consensus.cc:729] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02a95427f7a481cb00268650609de16, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.244277 31605 tablet_bootstrap.cc:492] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: No bootstrap required, opened a new log
I20260809 00:45:48.244580 31605 ts_tablet_manager.cc:1397] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260809 00:45:48.244887 31598 consensus_queue.cc:260] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.246160 31570 heartbeater.cc:503] Master 127.28.92.190:35725 was elected leader, sending a full tablet report...
I20260809 00:45:48.246671 31598 ts_tablet_manager.cc:1428] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Time spent starting tablet: real 0.011s user 0.004s sys 0.006s
I20260809 00:45:48.249228 31600 raft_consensus.cc:348] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.249747 31600 raft_consensus.cc:374] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.249883 31600 raft_consensus.cc:729] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 321fb5cb73e04b50bbf1abbe2ddc94f2, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.250481 31600 consensus_queue.cc:260] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.251624 31343 heartbeater.cc:503] Master 127.28.92.190:35725 was elected leader, sending a full tablet report...
I20260809 00:45:48.253516 31600 ts_tablet_manager.cc:1428] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260809 00:45:48.254901 31605 raft_consensus.cc:348] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.255290 31605 raft_consensus.cc:374] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.255388 31605 raft_consensus.cc:729] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e998fc62fe4e4adfbe24b589443c66b9, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.255898 31605 consensus_queue.cc:260] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.257241 31605 ts_tablet_manager.cc:1428] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260809 00:45:48.363265 31122 tablet.cc:2369] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:45:48.366928 31571 tablet.cc:2369] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:45:48.378134 31344 tablet.cc:2369] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:45:48.405717 31608 raft_consensus.cc:482] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:48.406062 31608 raft_consensus.cc:504] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.407761 31608 leader_election.cc:288] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535), 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633)
I20260809 00:45:48.414247 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.408275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:50279 (local address 127.28.92.129:38535)
0809 00:45:48.408536 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.408543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.408566 (+ 23us) server_negotiation.cc:407] Connection header received
0809 00:45:48.408645 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.408650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.408750 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.408852 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.409288 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.410299 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.412263 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.413426 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.413547 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.413600 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.413967 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.414056 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260809 00:45:48.414386 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.407990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:38535 (local address 127.28.92.131:50279)
0809 00:45:48.408274 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.408296 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.408438 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.408883 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.408887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.408915 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.409144 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.409156 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.410419 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.410425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.412097 (+ 1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.412109 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.413564 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.413570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.413811 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.413847 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.413954 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.414086 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":40}
I20260809 00:45:48.415277 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.408327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:36461 (local address 127.28.92.130:42633)
0809 00:45:48.408727 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.408733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.409017 (+ 284us) server_negotiation.cc:407] Connection header received
0809 00:45:48.409178 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.409183 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.409260 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.409334 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.410065 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.411063 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.413287 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.414462 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.414640 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.414708 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.414991 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.415093 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248}
I20260809 00:45:48.415460 31613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.408110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:42633 (local address 127.28.92.131:36461)
0809 00:45:48.408908 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.408927 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.409054 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.409377 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.409381 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.409407 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.409899 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.409912 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.411208 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.411212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.413117 (+ 1905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.413132 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.414716 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.414723 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.414841 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.414864 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.414937 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.415047 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":37,"thread_start_us":426,"threads_started":1}
I20260809 00:45:48.415620 31046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b62520beda94504acee2ecad3b7799f" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e998fc62fe4e4adfbe24b589443c66b9" is_pre_election: true
I20260809 00:45:48.416250 31046 raft_consensus.cc:2454] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 0.
I20260809 00:45:48.416469 31268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b62520beda94504acee2ecad3b7799f" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" is_pre_election: true
I20260809 00:45:48.416963 31268 raft_consensus.cc:2454] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 0.
I20260809 00:45:48.416960 31386 leader_election.cc:302] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e998fc62fe4e4adfbe24b589443c66b9, f02a95427f7a481cb00268650609de16; no voters:
I20260809 00:45:48.417325 31608 raft_consensus.cc:2781] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:48.417516 31608 raft_consensus.cc:482] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:48.417677 31608 raft_consensus.cc:3037] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:48.420017 31608 raft_consensus.cc:504] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.420639 31608 leader_election.cc:288] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 election: Requested vote from peers e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535), 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633)
I20260809 00:45:48.421046 31046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b62520beda94504acee2ecad3b7799f" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e998fc62fe4e4adfbe24b589443c66b9"
I20260809 00:45:48.421087 31268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b62520beda94504acee2ecad3b7799f" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2"
I20260809 00:45:48.421226 31046 raft_consensus.cc:3037] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:48.421259 31268 raft_consensus.cc:3037] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:48.423458 31046 raft_consensus.cc:2454] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 1.
I20260809 00:45:48.423471 31268 raft_consensus.cc:2454] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 1.
I20260809 00:45:48.423842 31386 leader_election.cc:302] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e998fc62fe4e4adfbe24b589443c66b9, f02a95427f7a481cb00268650609de16; no voters:
I20260809 00:45:48.424135 31608 raft_consensus.cc:2781] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:48.424638 31608 raft_consensus.cc:686] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 1 LEADER]: Becoming Leader. State: Replica: f02a95427f7a481cb00268650609de16, State: Running, Role: LEADER
I20260809 00:45:48.425099 31608 consensus_queue.cc:237] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } }
I20260809 00:45:48.429773 30798 catalog_manager.cc:5495] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 reported cstate change: term changed from 0 to 1, leader changed from <none> to f02a95427f7a481cb00268650609de16 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } health_report { overall_health: UNKNOWN } } }
I20260809 00:45:48.514138 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.508064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59886 (local address 127.28.92.131:32855)
0809 00:45:48.508291 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.508298 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.508428 (+ 130us) server_negotiation.cc:407] Connection header received
0809 00:45:48.508795 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.508799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.508880 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.509127 (+ 247us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:48.509520 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.510339 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.511773 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.512219 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.512338 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.512866 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:48.513475 (+ 609us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:48.513628 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.513769 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.513856 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:45:48.523701 31268 raft_consensus.cc:1261] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Refusing update from remote peer f02a95427f7a481cb00268650609de16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:48.524816 31615 consensus_queue.cc:1035] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:48.525578 31046 raft_consensus.cc:1261] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Refusing update from remote peer f02a95427f7a481cb00268650609de16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:48.526510 31615 consensus_queue.cc:1035] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:48.539353 31621 mvcc.cc:205] Tried to move back new op lower bound from 7316424083541065728 to 7316424083152814080. Current Snapshot: MvccSnapshot[applied={T|T < 7316424083541065728}]
I20260809 00:45:48.541386 31626 mvcc.cc:205] Tried to move back new op lower bound from 7316424083541065728 to 7316424083152814080. Current Snapshot: MvccSnapshot[applied={T|T < 7316424083541065728}]
I20260809 00:45:48.569489 30796 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:48.569850 30796 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:48.574116 30796 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: Sending DeleteTablet for 3 replicas of tablet 4b62520beda94504acee2ecad3b7799f
I20260809 00:45:48.575454 31450 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b62520beda94504acee2ecad3b7799f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:48 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:59874
I20260809 00:45:48.575569 31234 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b62520beda94504acee2ecad3b7799f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:48 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60090
I20260809 00:45:48.575932 31015 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b62520beda94504acee2ecad3b7799f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:48 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:33338
I20260809 00:45:48.580225 30796 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:45:48.581039 30796 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:48.593197 31013 tablet_service.cc:1467] Processing CreateTablet for tablet f92fbdee54c74b5ebb7fc693769532b1 (DEFAULT_TABLE table=test-table [id=1020ff2bbbae4450b9e49e2404eccd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:48.593336 31233 tablet_service.cc:1467] Processing CreateTablet for tablet f92fbdee54c74b5ebb7fc693769532b1 (DEFAULT_TABLE table=test-table [id=1020ff2bbbae4450b9e49e2404eccd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:48.593597 31449 tablet_service.cc:1467] Processing CreateTablet for tablet f92fbdee54c74b5ebb7fc693769532b1 (DEFAULT_TABLE table=test-table [id=1020ff2bbbae4450b9e49e2404eccd83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:48.593914 31013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92fbdee54c74b5ebb7fc693769532b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.594085 31233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92fbdee54c74b5ebb7fc693769532b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.594290 31449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f92fbdee54c74b5ebb7fc693769532b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.596381 31644 tablet_replica.cc:330] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: stopping tablet replica
I20260809 00:45:48.597057 31645 tablet_replica.cc:330] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: stopping tablet replica
I20260809 00:45:48.597913 31645 raft_consensus.cc:2229] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:48.598526 31644 raft_consensus.cc:2229] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:48.599426 31644 raft_consensus.cc:2258] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:48.599814 31645 raft_consensus.cc:2258] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:48.601009 31643 tablet_replica.cc:330] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: stopping tablet replica
I20260809 00:45:48.601227 31600 tablet_bootstrap.cc:492] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Bootstrap starting.
I20260809 00:45:48.601253 31605 tablet_bootstrap.cc:492] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Bootstrap starting.
I20260809 00:45:48.601557 31643 raft_consensus.cc:2229] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:45:48.602430 31643 raft_consensus.cc:2258] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:48.602679 31605 tablet_bootstrap.cc:654] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.602967 31600 tablet_bootstrap.cc:654] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.604746 31598 tablet_bootstrap.cc:492] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Bootstrap starting.
I20260809 00:45:48.605057 31643 ts_tablet_manager.cc:1905] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:48.606490 31598 tablet_bootstrap.cc:654] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.608227 31644 ts_tablet_manager.cc:1905] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:48.608268 31645 ts_tablet_manager.cc:1905] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:48.610419 31605 tablet_bootstrap.cc:492] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: No bootstrap required, opened a new log
I20260809 00:45:48.610570 31605 ts_tablet_manager.cc:1397] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260809 00:45:48.611392 31605 raft_consensus.cc:348] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.611632 31605 raft_consensus.cc:374] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.611743 31605 raft_consensus.cc:729] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e998fc62fe4e4adfbe24b589443c66b9, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.612026 31605 consensus_queue.cc:260] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.612751 31643 ts_tablet_manager.cc:1918] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:45:48.613020 31643 log.cc:1196] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/4b62520beda94504acee2ecad3b7799f
I20260809 00:45:48.613783 31605 ts_tablet_manager.cc:1428] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:48.613971 31643 ts_tablet_manager.cc:1939] T 4b62520beda94504acee2ecad3b7799f P f02a95427f7a481cb00268650609de16: Deleting consensus metadata
I20260809 00:45:48.615865 30771 catalog_manager.cc:4841] TS f02a95427f7a481cb00268650609de16 (127.28.92.131:32855): tablet 4b62520beda94504acee2ecad3b7799f (table test-table [id=af5bd5a8e4ec4af4bc47936122985a24]) successfully deleted
I20260809 00:45:48.616954 31598 tablet_bootstrap.cc:492] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: No bootstrap required, opened a new log
I20260809 00:45:48.617122 31598 ts_tablet_manager.cc:1397] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260809 00:45:48.617997 31598 raft_consensus.cc:348] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.618217 31598 raft_consensus.cc:374] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.618330 31598 raft_consensus.cc:729] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02a95427f7a481cb00268650609de16, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.618580 31598 consensus_queue.cc:260] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.619750 31598 ts_tablet_manager.cc:1428] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 00:45:48.622886 31644 ts_tablet_manager.cc:1918] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:45:48.623061 31644 log.cc:1196] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/4b62520beda94504acee2ecad3b7799f
I20260809 00:45:48.623518 31644 ts_tablet_manager.cc:1939] T 4b62520beda94504acee2ecad3b7799f P 321fb5cb73e04b50bbf1abbe2ddc94f2: Deleting consensus metadata
I20260809 00:45:48.625272 30771 catalog_manager.cc:4841] TS 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633): tablet 4b62520beda94504acee2ecad3b7799f (table test-table [id=af5bd5a8e4ec4af4bc47936122985a24]) successfully deleted
I20260809 00:45:48.626506 31600 tablet_bootstrap.cc:492] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: No bootstrap required, opened a new log
I20260809 00:45:48.626660 31600 ts_tablet_manager.cc:1397] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.004s
I20260809 00:45:48.627405 31600 raft_consensus.cc:348] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.627621 31600 raft_consensus.cc:374] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.627701 31600 raft_consensus.cc:729] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 321fb5cb73e04b50bbf1abbe2ddc94f2, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.627949 31600 consensus_queue.cc:260] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.628966 31600 ts_tablet_manager.cc:1428] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 00:45:48.631281 31645 ts_tablet_manager.cc:1918] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:45:48.631467 31645 log.cc:1196] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/4b62520beda94504acee2ecad3b7799f
I20260809 00:45:48.631999 31645 ts_tablet_manager.cc:1939] T 4b62520beda94504acee2ecad3b7799f P e998fc62fe4e4adfbe24b589443c66b9: Deleting consensus metadata
I20260809 00:45:48.635219 30773 catalog_manager.cc:4841] TS e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535): tablet 4b62520beda94504acee2ecad3b7799f (table test-table [id=af5bd5a8e4ec4af4bc47936122985a24]) successfully deleted
I20260809 00:45:48.731685 31612 raft_consensus.cc:482] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:48.731992 31612 raft_consensus.cc:504] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.734093 31612 leader_election.cc:288] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633), f02a95427f7a481cb00268650609de16 (127.28.92.131:32855)
I20260809 00:45:48.743193 31597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.734355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:51771 (local address 127.28.92.130:42633)
0809 00:45:48.734560 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.734567 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.734968 (+ 401us) server_negotiation.cc:407] Connection header received
0809 00:45:48.735221 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.735227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.735309 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.735377 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.737163 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.738141 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.740835 (+ 2694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.741752 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.741899 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.741988 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.742644 (+ 656us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.742768 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:45:48.743242 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.734311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:42633 (local address 127.28.92.129:51771)
0809 00:45:48.734871 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.734889 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.735029 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.735869 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.735874 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.735908 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.736864 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.736881 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.738309 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.738313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.740679 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.740692 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.742313 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.742321 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.742489 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.742515 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.742600 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.742729 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":284,"threads_started":1}
I20260809 00:45:48.743829 31268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f92fbdee54c74b5ebb7fc693769532b1" candidate_uuid: "e998fc62fe4e4adfbe24b589443c66b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" is_pre_election: true
I20260809 00:45:48.744107 31268 raft_consensus.cc:2454] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e998fc62fe4e4adfbe24b589443c66b9 in term 0.
I20260809 00:45:48.744565 30929 leader_election.cc:302] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 321fb5cb73e04b50bbf1abbe2ddc94f2, e998fc62fe4e4adfbe24b589443c66b9; no voters:
I20260809 00:45:48.744952 31612 raft_consensus.cc:2781] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:48.745157 31612 raft_consensus.cc:482] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:48.745311 31612 raft_consensus.cc:3037] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:48.746320 31654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.735040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:32855 (local address 127.28.92.129:50681)
0809 00:45:48.736751 (+ 1711us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.736767 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.736920 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.737312 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.737318 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.737347 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:48.738219 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.738236 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.740199 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.740205 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.743021 (+ 2816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.743039 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.745249 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.745258 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.745526 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.745563 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.745732 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.745869 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1559,"thread_start_us":1309,"threads_started":1}
I20260809 00:45:48.746749 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.735516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:50681 (local address 127.28.92.131:32855)
0809 00:45:48.735709 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.735715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.736855 (+ 1140us) server_negotiation.cc:407] Connection header received
0809 00:45:48.737059 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.737063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.737135 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.737225 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:48.738431 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.740051 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.743224 (+ 3173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.744788 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.744936 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.745008 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.745766 (+ 758us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.745899 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:45:48.748041 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f92fbdee54c74b5ebb7fc693769532b1" candidate_uuid: "e998fc62fe4e4adfbe24b589443c66b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02a95427f7a481cb00268650609de16" is_pre_election: true
I20260809 00:45:48.748544 31488 raft_consensus.cc:2454] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e998fc62fe4e4adfbe24b589443c66b9 in term 0.
I20260809 00:45:48.749128 31612 raft_consensus.cc:504] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.749850 31612 leader_election.cc:288] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [CANDIDATE]: Term 1 election: Requested vote from peers 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633), f02a95427f7a481cb00268650609de16 (127.28.92.131:32855)
I20260809 00:45:48.750360 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f92fbdee54c74b5ebb7fc693769532b1" candidate_uuid: "e998fc62fe4e4adfbe24b589443c66b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02a95427f7a481cb00268650609de16"
I20260809 00:45:48.750458 31268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f92fbdee54c74b5ebb7fc693769532b1" candidate_uuid: "e998fc62fe4e4adfbe24b589443c66b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2"
I20260809 00:45:48.750588 31488 raft_consensus.cc:3037] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:48.750664 31268 raft_consensus.cc:3037] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:48.753800 31268 raft_consensus.cc:2454] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e998fc62fe4e4adfbe24b589443c66b9 in term 1.
I20260809 00:45:48.754201 30929 leader_election.cc:302] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 321fb5cb73e04b50bbf1abbe2ddc94f2, e998fc62fe4e4adfbe24b589443c66b9; no voters:
I20260809 00:45:48.754294 31488 raft_consensus.cc:2454] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e998fc62fe4e4adfbe24b589443c66b9 in term 1.
I20260809 00:45:48.754745 31612 raft_consensus.cc:2781] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:48.755681 31612 raft_consensus.cc:686] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 1 LEADER]: Becoming Leader. State: Replica: e998fc62fe4e4adfbe24b589443c66b9, State: Running, Role: LEADER
I20260809 00:45:48.756232 31612 consensus_queue.cc:237] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.760126 30798 catalog_manager.cc:5495] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "e998fc62fe4e4adfbe24b589443c66b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } health_report { overall_health: UNKNOWN } } }
Aug 09 00:45:48 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236346, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:48.851046 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.832420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51372 (local address 127.28.92.190:35725)
0809 00:45:48.833415 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:48.833419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:48.833436 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:45:48.833478 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:48.833481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:48.833538 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:48.833626 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:48.834778 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.835587 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.836860 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.837264 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.837367 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.844827 (+ 7460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:48.844832 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:48.844835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:48.844864 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:48.847606 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.848739 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.848742 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.848745 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.848861 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:48.849403 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:48.849406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:48.849408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:48.849708 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:48.849815 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:48.850414 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 00:45:48.850740 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":150,"server-negotiator.queue_time_us":883,"thread_start_us":730,"threads_started":1}
I20260809 00:45:48.851588 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:48.832359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35725 (local address 127.0.0.1:51372)
0809 00:45:48.833074 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:48.833096 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:48.833265 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:48.833701 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:48.833705 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:48.834407 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:48.834631 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.834641 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.835727 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.835731 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.836727 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:48.836742 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:48.837411 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:48.837417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:48.837595 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:48.841987 (+ 4392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:48.842004 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:48.844634 (+ 2630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:48.847760 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:48.847774 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:48.847782 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:48.848631 (+ 849us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:48.848962 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:48.848968 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:48.848971 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:48.849303 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:48.849833 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:48.849841 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:48.850077 (+ 236us) client_negotiation.cc:769] Sending connection context
0809 00:45:48.850333 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 00:45:48.850641 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":397,"threads_started":1}
I20260809 00:45:48.857172 30798 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:51372:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 00:45:48.858428 30798 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:48.865296 31015 tablet_service.cc:1467] Processing CreateTablet for tablet bbce0388f94e4bf0be0eaf47c04058df (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c205926bc4934ee980cf3902d230276d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:45:48.865725 31233 tablet_service.cc:1467] Processing CreateTablet for tablet bbce0388f94e4bf0be0eaf47c04058df (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c205926bc4934ee980cf3902d230276d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:45:48.865950 31015 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbce0388f94e4bf0be0eaf47c04058df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.865739 31449 tablet_service.cc:1467] Processing CreateTablet for tablet bbce0388f94e4bf0be0eaf47c04058df (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c205926bc4934ee980cf3902d230276d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:45:48.866362 31233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbce0388f94e4bf0be0eaf47c04058df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.866389 31449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbce0388f94e4bf0be0eaf47c04058df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:48.875967 31598 tablet_bootstrap.cc:492] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: Bootstrap starting.
I20260809 00:45:48.878396 31600 tablet_bootstrap.cc:492] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: Bootstrap starting.
I20260809 00:45:48.878783 31598 tablet_bootstrap.cc:654] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.878952 31605 tablet_bootstrap.cc:492] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: Bootstrap starting.
I20260809 00:45:48.881399 31600 tablet_bootstrap.cc:654] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.881978 31605 tablet_bootstrap.cc:654] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:48.894423 31605 tablet_bootstrap.cc:492] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: No bootstrap required, opened a new log
I20260809 00:45:48.894730 31605 ts_tablet_manager.cc:1397] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.009s
I20260809 00:45:48.895879 31600 tablet_bootstrap.cc:492] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: No bootstrap required, opened a new log
I20260809 00:45:48.896154 31600 ts_tablet_manager.cc:1397] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.012s
I20260809 00:45:48.896050 31605 raft_consensus.cc:348] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.896436 31605 raft_consensus.cc:374] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.896610 31605 raft_consensus.cc:729] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e998fc62fe4e4adfbe24b589443c66b9, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.897032 31605 consensus_queue.cc:260] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.897171 31600 raft_consensus.cc:348] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.897485 31600 raft_consensus.cc:374] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.897595 31600 raft_consensus.cc:729] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 321fb5cb73e04b50bbf1abbe2ddc94f2, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.897941 31600 consensus_queue.cc:260] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.898247 31612 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:48.898850 31612 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:48.898480 31609 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:48.899039 31609 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:48.899873 31605 ts_tablet_manager.cc:1428] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260809 00:45:48.900868 31600 ts_tablet_manager.cc:1428] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260809 00:45:48.908299 31598 tablet_bootstrap.cc:492] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: No bootstrap required, opened a new log
I20260809 00:45:48.908522 31598 ts_tablet_manager.cc:1397] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: Time spent bootstrapping tablet: real 0.033s user 0.018s sys 0.004s
I20260809 00:45:48.909205 31598 raft_consensus.cc:348] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.909425 31598 raft_consensus.cc:374] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:48.909519 31598 raft_consensus.cc:729] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f02a95427f7a481cb00268650609de16, State: Initialized, Role: FOLLOWER
I20260809 00:45:48.909842 31598 consensus_queue.cc:260] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:48.910591 31598 ts_tablet_manager.cc:1428] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 00:45:48.910295 31640 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:48.910840 31640 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:49.036674 31609 raft_consensus.cc:482] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:49.037025 31609 raft_consensus.cc:504] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:49.039407 31609 leader_election.cc:288] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535), f02a95427f7a481cb00268650609de16 (127.28.92.131:32855)
I20260809 00:45:49.050238 31640 raft_consensus.cc:482] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:49.050458 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.039732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:32855 (local address 127.28.92.130:35501)
0809 00:45:49.041318 (+ 1586us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:49.041335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:49.041478 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:49.042047 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:49.042053 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:49.042078 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:49.042781 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.042793 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.044089 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.044095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.047090 (+ 2995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.047109 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.049351 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.049355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.049501 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.049524 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:45:49.049604 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:45:49.049770 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1471,"mutex_wait_us":40,"thread_start_us":731,"threads_started":1}
I20260809 00:45:49.050531 31640 raft_consensus.cc:504] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:49.051373 31640 leader_election.cc:288] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535), 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633)
I20260809 00:45:49.052098 31670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.039610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:38535 (local address 127.28.92.130:54711)
0809 00:45:49.041158 (+ 1548us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:49.041183 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:49.041442 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:49.042022 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:49.042027 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:49.042058 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:49.042790 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.042806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.045035 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.045041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.048595 (+ 3554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.048612 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.050895 (+ 2283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.050906 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.051193 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.051228 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 00:45:49.051322 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 00:45:49.051472 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1384,"mutex_wait_us":5,"thread_start_us":1278,"threads_started":1}
I20260809 00:45:49.052448 31046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e998fc62fe4e4adfbe24b589443c66b9" is_pre_election: true
I20260809 00:45:49.052821 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.039892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:54711 (local address 127.28.92.129:38535)
0809 00:45:49.041173 (+ 1281us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.041178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.041280 (+ 102us) server_negotiation.cc:407] Connection header received
0809 00:45:49.041676 (+ 396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.041681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.041750 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.041835 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:49.043092 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.044876 (+ 1784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.048781 (+ 3905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.050172 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.050417 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.050532 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.051821 (+ 1289us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.051994 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1150,"thread_start_us":907,"threads_started":1}
I20260809 00:45:49.053301 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.039860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:35501 (local address 127.28.92.131:32855)
0809 00:45:49.040114 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.040121 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.041416 (+ 1295us) server_negotiation.cc:407] Connection header received
0809 00:45:49.041632 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.041638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.041745 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.041832 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:49.043027 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.043962 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.047325 (+ 3363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.048978 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.049102 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.049157 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.049681 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.049843 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 00:45:49.053514 31268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" is_pre_election: true
I20260809 00:45:49.053689 31045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e998fc62fe4e4adfbe24b589443c66b9" is_pre_election: true
I20260809 00:45:49.053906 31268 raft_consensus.cc:2454] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 0.
I20260809 00:45:49.054546 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02a95427f7a481cb00268650609de16" is_pre_election: true
I20260809 00:45:49.054828 31488 raft_consensus.cc:2454] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 321fb5cb73e04b50bbf1abbe2ddc94f2 in term 0.
I20260809 00:45:49.055362 31383 leader_election.cc:302] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 321fb5cb73e04b50bbf1abbe2ddc94f2, f02a95427f7a481cb00268650609de16; no voters:
I20260809 00:45:49.055372 31164 leader_election.cc:302] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 321fb5cb73e04b50bbf1abbe2ddc94f2, f02a95427f7a481cb00268650609de16; no voters: e998fc62fe4e4adfbe24b589443c66b9
I20260809 00:45:49.055677 31640 raft_consensus.cc:2781] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:49.055807 31640 raft_consensus.cc:482] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:49.055912 31640 raft_consensus.cc:3037] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:49.052845 31046 raft_consensus.cc:2454] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 0.
I20260809 00:45:49.056537 31609 raft_consensus.cc:2781] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:49.056680 31609 raft_consensus.cc:482] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:49.056782 31609 raft_consensus.cc:3037] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:49.059320 31640 raft_consensus.cc:504] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:49.060266 31640 leader_election.cc:288] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 election: Requested vote from peers e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535), 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633)
I20260809 00:45:49.060042 31609 raft_consensus.cc:504] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:49.060645 31046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e998fc62fe4e4adfbe24b589443c66b9"
I20260809 00:45:49.060890 31046 raft_consensus.cc:3037] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:49.061107 31609 leader_election.cc:288] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [CANDIDATE]: Term 1 election: Requested vote from peers e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535), f02a95427f7a481cb00268650609de16 (127.28.92.131:32855)
I20260809 00:45:49.061841 31045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e998fc62fe4e4adfbe24b589443c66b9"
I20260809 00:45:49.062605 31268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "f02a95427f7a481cb00268650609de16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2"
I20260809 00:45:49.062955 31268 raft_consensus.cc:2379] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f02a95427f7a481cb00268650609de16 in current term 1: Already voted for candidate 321fb5cb73e04b50bbf1abbe2ddc94f2 in this term.
I20260809 00:45:49.062886 31488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbce0388f94e4bf0be0eaf47c04058df" candidate_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f02a95427f7a481cb00268650609de16"
I20260809 00:45:49.063256 31488 raft_consensus.cc:2379] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 321fb5cb73e04b50bbf1abbe2ddc94f2 in current term 1: Already voted for candidate f02a95427f7a481cb00268650609de16 in this term.
I20260809 00:45:49.064203 31164 leader_election.cc:302] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 321fb5cb73e04b50bbf1abbe2ddc94f2; no voters: e998fc62fe4e4adfbe24b589443c66b9, f02a95427f7a481cb00268650609de16
I20260809 00:45:49.064503 31046 raft_consensus.cc:2454] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f02a95427f7a481cb00268650609de16 in term 1.
I20260809 00:45:49.064824 31609 raft_consensus.cc:2726] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 00:45:49.064991 31386 leader_election.cc:302] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e998fc62fe4e4adfbe24b589443c66b9, f02a95427f7a481cb00268650609de16; no voters: 321fb5cb73e04b50bbf1abbe2ddc94f2
I20260809 00:45:49.065340 31640 raft_consensus.cc:2781] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:49.065984 31640 raft_consensus.cc:686] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [term 1 LEADER]: Becoming Leader. State: Replica: f02a95427f7a481cb00268650609de16, State: Running, Role: LEADER
I20260809 00:45:49.066300 31640 consensus_queue.cc:237] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } }
I20260809 00:45:49.068322 31674 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: TxnStatusTablet state changed. Reason: New leader f02a95427f7a481cb00268650609de16. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.069069 31674 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:45:49.070393 31678 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 00:45:49.070803 31678 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 00:45:49.071599 30796 catalog_manager.cc:5495] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 reported cstate change: term changed from 0 to 1, leader changed from <none> to f02a95427f7a481cb00268650609de16 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } health_report { overall_health: HEALTHY } } }
I20260809 00:45:49.143163 31664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.134420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:32855 (local address 127.0.0.1:59890)
0809 00:45:49.134774 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:49.134798 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:49.134977 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:49.135737 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:49.135743 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:49.135759 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:49.135993 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.136004 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.137917 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.137924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.139816 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.139834 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.141278 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.141285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.141584 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.141701 (+ 117us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.142284 (+ 583us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.142312 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 00:45:49.142390 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 00:45:49.142597 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 00:45:49.144134 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.134911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.28.92.131:32855)
0809 00:45:49.135104 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.135112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.135137 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:45:49.135222 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.135227 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.135324 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.135459 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:49.136199 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.137732 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.140004 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.140999 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.141125 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.141998 (+ 873us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.142148 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.142229 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.143676 (+ 1447us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.143782 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 00:45:49.154451 31268 raft_consensus.cc:1261] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Refusing update from remote peer f02a95427f7a481cb00268650609de16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:49.155419 31046 raft_consensus.cc:1261] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Refusing update from remote peer f02a95427f7a481cb00268650609de16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:49.156342 31674 consensus_queue.cc:1035] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:49.158747 31674 consensus_queue.cc:1035] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:49.174674 31612 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: TxnStatusTablet state changed. Reason: New leader f02a95427f7a481cb00268650609de16. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.175091 31612 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:49.178859 31612 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.179276 31612 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P e998fc62fe4e4adfbe24b589443c66b9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:49.180872 31609 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: TxnStatusTablet state changed. Reason: New leader f02a95427f7a481cb00268650609de16. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.181300 31609 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:49.184684 31674 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.185135 31674 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:45:49.185493 31674 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.185864 31674 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P f02a95427f7a481cb00268650609de16: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:45:49.205588 31609 tablet_replica.cc:439] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f02a95427f7a481cb00268650609de16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e998fc62fe4e4adfbe24b589443c66b9" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38535 } } peers { permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 } } peers { permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 } } }
I20260809 00:45:49.206115 31609 tablet_replica.cc:442] T bbce0388f94e4bf0be0eaf47c04058df P 321fb5cb73e04b50bbf1abbe2ddc94f2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:49.222760 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.210994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33352 (local address 127.28.92.129:38535)
0809 00:45:49.211271 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.211277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.212568 (+ 1291us) server_negotiation.cc:407] Connection header received
0809 00:45:49.212781 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.212787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.212909 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.213100 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:49.214062 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.215782 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.219133 (+ 3351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.220190 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.220335 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.221044 (+ 709us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.221970 (+ 926us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.222132 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.222243 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.222348 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 00:45:49.248377 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.239150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:37347 (local address 127.28.92.131:32855)
0809 00:45:49.239399 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.239406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.240693 (+ 1287us) server_negotiation.cc:407] Connection header received
0809 00:45:49.240967 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.240973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.241065 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.241160 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:49.242286 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.243747 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.245929 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.246641 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.246781 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.247466 (+ 685us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.247678 (+ 212us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.247778 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.247936 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.248031 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113}
I20260809 00:45:49.248390 31701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.239385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:32855 (local address 127.28.92.129:37347)
0809 00:45:49.240562 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:49.240585 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:49.240766 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:49.241188 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:49.241194 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:49.241207 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:49.242084 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.242098 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.243956 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.243963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.245734 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.245761 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.246951 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.246958 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.247149 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.247227 (+ 78us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.247799 (+ 572us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.247812 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 00:45:49.247902 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 00:45:49.248044 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"thread_start_us":656,"threads_started":1}
I20260809 00:45:49.262660 31488 raft_consensus.cc:1261] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Refusing update from remote peer e998fc62fe4e4adfbe24b589443c66b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:49.263598 31612 consensus_queue.cc:1035] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f02a95427f7a481cb00268650609de16" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:49.267372 31268 raft_consensus.cc:1261] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Refusing update from remote peer e998fc62fe4e4adfbe24b589443c66b9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:49.268087 31612 consensus_queue.cc:1035] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "321fb5cb73e04b50bbf1abbe2ddc94f2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:49.337452 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.327004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:34341 (local address 127.28.92.129:38535)
0809 00:45:49.327206 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.327213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.331608 (+ 4395us) server_negotiation.cc:407] Connection header received
0809 00:45:49.332147 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.332153 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.332267 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.332334 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:49.333089 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.333944 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.335451 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.335920 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.336037 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.336554 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.336703 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.336764 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.337036 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.337122 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 00:45:49.338616 31712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.324749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:38535 (local address 127.28.92.131:34341)
0809 00:45:49.331495 (+ 6746us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:49.331516 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:49.331958 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:49.332531 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:49.332534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:49.332544 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:49.332902 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.332910 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.334074 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.334077 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.335310 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:49.335322 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.336113 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.336118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:49.336270 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.336339 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:49.336874 (+ 535us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:49.336885 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 00:45:49.337953 (+ 1068us) client_negotiation.cc:240] Negotiation successful
0809 00:45:49.338100 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6515,"thread_start_us":6876,"threads_started":1}
I20260809 00:45:49.407675 30796 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:49.407989 30796 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:49.411876 30796 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf5e42331a414b348e5dd4066fd28273: Sending DeleteTablet for 3 replicas of tablet f92fbdee54c74b5ebb7fc693769532b1
I20260809 00:45:49.412809 31015 tablet_service.cc:1514] Processing DeleteTablet for tablet f92fbdee54c74b5ebb7fc693769532b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:49 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:33338
I20260809 00:45:49.413340 31233 tablet_service.cc:1514] Processing DeleteTablet for tablet f92fbdee54c74b5ebb7fc693769532b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:49 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60090
I20260809 00:45:49.422844 31719 tablet_replica.cc:330] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: stopping tablet replica
I20260809 00:45:49.422887 31449 tablet_service.cc:1514] Processing DeleteTablet for tablet f92fbdee54c74b5ebb7fc693769532b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:49 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:59874
I20260809 00:45:49.423763 31719 raft_consensus.cc:2229] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:49.424417 31719 raft_consensus.cc:2258] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:49.426458 31719 ts_tablet_manager.cc:1905] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:49.430708 31721 tablet_replica.cc:330] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: stopping tablet replica
I20260809 00:45:49.431475 31717 tablet_replica.cc:330] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: stopping tablet replica
I20260809 00:45:49.431871 31717 raft_consensus.cc:2229] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:45:49.432621 31717 raft_consensus.cc:2258] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:49.432698 31721 raft_consensus.cc:2229] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:49.433228 31721 raft_consensus.cc:2258] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:49.434238 31717 ts_tablet_manager.cc:1905] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:49.436762 31719 ts_tablet_manager.cc:1918] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:49.437040 31719 log.cc:1196] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/f92fbdee54c74b5ebb7fc693769532b1
I20260809 00:45:49.437184 31721 ts_tablet_manager.cc:1905] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:49.438031 31719 ts_tablet_manager.cc:1939] T f92fbdee54c74b5ebb7fc693769532b1 P 321fb5cb73e04b50bbf1abbe2ddc94f2: Deleting consensus metadata
I20260809 00:45:49.439381 30771 catalog_manager.cc:4841] TS 321fb5cb73e04b50bbf1abbe2ddc94f2 (127.28.92.130:42633): tablet f92fbdee54c74b5ebb7fc693769532b1 (table test-table [id=1020ff2bbbae4450b9e49e2404eccd83]) successfully deleted
I20260809 00:45:49.448853 31717 ts_tablet_manager.cc:1918] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:49.449080 31717 log.cc:1196] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/f92fbdee54c74b5ebb7fc693769532b1
I20260809 00:45:49.452677 31721 ts_tablet_manager.cc:1918] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:49.453121 31721 log.cc:1196] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/f92fbdee54c74b5ebb7fc693769532b1
I20260809 00:45:49.453471 31717 ts_tablet_manager.cc:1939] T f92fbdee54c74b5ebb7fc693769532b1 P e998fc62fe4e4adfbe24b589443c66b9: Deleting consensus metadata
I20260809 00:45:49.454267 31721 ts_tablet_manager.cc:1939] T f92fbdee54c74b5ebb7fc693769532b1 P f02a95427f7a481cb00268650609de16: Deleting consensus metadata
I20260809 00:45:49.455405 30773 catalog_manager.cc:4841] TS e998fc62fe4e4adfbe24b589443c66b9 (127.28.92.129:38535): tablet f92fbdee54c74b5ebb7fc693769532b1 (table test-table [id=1020ff2bbbae4450b9e49e2404eccd83]) successfully deleted
I20260809 00:45:49.455530 30771 catalog_manager.cc:4841] TS f02a95427f7a481cb00268650609de16 (127.28.92.131:32855): tablet f92fbdee54c74b5ebb7fc693769532b1 (table test-table [id=1020ff2bbbae4450b9e49e2404eccd83]) successfully deleted
Aug 09 00:45:49 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:49.474684 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.431621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33364 (local address 127.28.92.129:38535)
0809 00:45:49.431782 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.431788 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.442978 (+ 11190us) server_negotiation.cc:407] Connection header received
0809 00:45:49.443126 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.443131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.443228 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.443323 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:49.445682 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.446948 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.449144 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.452038 (+ 2894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.452170 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.463414 (+ 11244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:49.463437 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:49.463461 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:49.463517 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:49.469708 (+ 6191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.471069 (+ 1361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.471080 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.471084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.471340 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.471988 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.471994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.471998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.472759 (+ 761us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:49.473160 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.473910 (+ 750us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.474195 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 00:45:49.476878 31112 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33364
I20260809 00:45:49.506623 31725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.481347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.28.92.190:35725)
0809 00:45:49.482193 (+ 846us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.482200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.486223 (+ 4023us) server_negotiation.cc:407] Connection header received
0809 00:45:49.486425 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.486431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.486534 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.486663 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:49.488702 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.492461 (+ 3759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.494967 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.495661 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.495810 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.499209 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:49.499217 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:49.499222 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:49.499292 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:49.503002 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.504006 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.504013 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.504017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.504189 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.504724 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.504730 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.504732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.505106 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:49.505391 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.505873 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.506123 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":513,"threads_started":1}
W20260809 00:45:49.507351 30796 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51382
I20260809 00:45:49.509984 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30901
I20260809 00:45:49.532276 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.511228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33376 (local address 127.28.92.129:38535)
0809 00:45:49.512537 (+ 1309us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.512544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.514137 (+ 1593us) server_negotiation.cc:407] Connection header received
0809 00:45:49.514294 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.514301 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.514431 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.514549 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:49.516062 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.517571 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.519413 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.520267 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.520404 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.523591 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:49.523599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:49.523604 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:49.523655 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:49.528162 (+ 4507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.529064 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.529070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.529074 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.529261 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.529764 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.529769 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.529773 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.530203 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:49.530457 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.531640 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.531890 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1171}
W20260809 00:45:49.533206 31112 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33376
W20260809 00:45:49.533854 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30901: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:45:49.534053 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30901
I20260809 00:45:49.597715 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31129
Aug 09 00:45:49 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:45:49.615087 31729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.598559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60096 (local address 127.28.92.130:42633)
0809 00:45:49.599032 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.599038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.599059 (+ 21us) server_negotiation.cc:407] Connection header received
0809 00:45:49.599123 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.599129 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.599213 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.599329 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:49.600433 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.601462 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.602819 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.603473 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.603612 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.607978 (+ 4366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:49.608000 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:49.608022 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:49.608068 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:49.612065 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.612815 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.612827 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.612831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.613066 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.613436 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.613442 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.613445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.613955 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:49.614266 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.614467 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.614700 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":527,"threads_started":1}
W20260809 00:45:49.615896 31336 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60096
W20260809 00:45:49.616528 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31129: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:45:49.616693 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31129
I20260809 00:45:49.645327 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31348
Aug 09 00:45:49 dist-test-slave-t7g5 krb5kdc[30720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236348, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:45:49.661580 31593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:49.646090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59894 (local address 127.28.92.131:32855)
0809 00:45:49.646310 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:49.646316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:49.646338 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:45:49.646467 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:49.646473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:49.646568 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:49.646683 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:49.647834 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.648943 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.650209 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:49.650913 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:49.651048 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:49.655607 (+ 4559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:49.655621 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:49.655639 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:49.655677 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:49.658754 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.659561 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.659568 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.659570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.659720 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:49.660133 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:49.660136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:49.660138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:49.660489 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:49.660736 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:49.661088 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 00:45:49.661269 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260809 00:45:49.662333 31564 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59894
W20260809 00:45:49.663003 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31348: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:45:49.663172 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31348
I20260809 00:45:49.691502 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30742
I20260809 00:45:49.692611 30857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:49.807192 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30742
2026-08-09T00:45:49Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5094 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:45:49 dist-test-slave-t7g5 krb5kdc[31735](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:45:49 dist-test-slave-t7g5 krb5kdc[31735](info): set up 2 sockets
Aug 09 00:45:49 dist-test-slave-t7g5 krb5kdc[31735](info): commencing operation
krb5kdc: starting...
W20260809 00:45:51.027521 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.006s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:45:51 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:45:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:45:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:45:51.221535 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:42199
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:42199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:51.551375 31753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:51.551659 31753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:51.551802 31753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:51.558828 31753 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:45:51.558930 31753 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 00:45:51.558995 31753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:51.559079 31753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:51.559144 31753 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:45:51.559226 31753 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:45:51.568704 31753 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:42199
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:42199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:51.569932 31753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:51.571246 31753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:51.582541 31762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:51.582579 31769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:51.582504 31766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:51.583703 31753 server_base.cc:1034] running on GCE node
I20260809 00:45:51.584466 31753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:51.585899 31753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:51.587121 31753 hybrid_clock.cc:648] HybridClock initialized: now 1786236351587056 us; error 38 us; skew 500 ppm
I20260809 00:45:51.587436 31753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:51 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236351, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:51.590350 31753 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:45:51.591792 31753 webserver.cc:460] Webserver started at http://127.28.92.190:45871/ using document root <none> and password file <none>
I20260809 00:45:51.592476 31753 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:51.592576 31753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:51.592881 31753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:51.595849 31753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "8fd9782e7ce64d65838845b123664993"
format_stamp: "Formatted at 2026-08-09 00:45:51 on dist-test-slave-t7g5"
server_key: "2a40211da3a8493bc92499ba4368b6c6"
server_key_iv: "abfa2ec5abde0f50691cba901348cb38"
server_key_version: "encryptionkey@0"
I20260809 00:45:51.596596 31753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "8fd9782e7ce64d65838845b123664993"
format_stamp: "Formatted at 2026-08-09 00:45:51 on dist-test-slave-t7g5"
server_key: "2a40211da3a8493bc92499ba4368b6c6"
server_key_iv: "abfa2ec5abde0f50691cba901348cb38"
server_key_version: "encryptionkey@0"
I20260809 00:45:51.601526 31753 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:45:51.604812 31780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:51.606120 31753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:51.606289 31753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "8fd9782e7ce64d65838845b123664993"
format_stamp: "Formatted at 2026-08-09 00:45:51 on dist-test-slave-t7g5"
server_key: "2a40211da3a8493bc92499ba4368b6c6"
server_key_iv: "abfa2ec5abde0f50691cba901348cb38"
server_key_version: "encryptionkey@0"
I20260809 00:45:51.606484 31753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:51.638701 31753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:51.642540 31753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:51.642807 31753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:51.662351 31753 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:42199
I20260809 00:45:51.662328 31881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:42199 every 8 connection(s)
I20260809 00:45:51.663640 31753 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:45:51.667207 31882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:51.669075 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31753
I20260809 00:45:51.669257 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:45:51.669914 29042 external_mini_cluster.cc:1428] Setting key 006a0b3789826311e30eb39069429cec
I20260809 00:45:51.678808 31882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Bootstrap starting.
I20260809 00:45:51.682595 31882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:51.683823 31882 log.cc:824] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Log is configured to *not* fsync() on all Append() calls
Aug 09 00:45:51 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:51.687227 31882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: No bootstrap required, opened a new log
I20260809 00:45:51.693576 31885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:51.671746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45276 (local address 127.28.92.190:42199)
0809 00:45:51.672500 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:51.672512 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:51.672550 (+ 38us) server_negotiation.cc:407] Connection header received
0809 00:45:51.674259 (+ 1709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:51.674283 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:51.674630 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:51.674949 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:51.676687 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:51.678041 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:51.679717 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:51.680382 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:51.680523 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:51.685251 (+ 4728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:51.685264 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:51.685284 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:51.685325 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:51.689063 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:51.689746 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:51.689755 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:51.689764 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:51.689985 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:51.690314 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:51.690320 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:51.690323 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:51.691048 (+ 725us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:51.691356 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:51.691669 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 00:45:51.692236 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":328,"threads_started":1}
I20260809 00:45:51.697052 31882 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd9782e7ce64d65838845b123664993" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42199 } }
I20260809 00:45:51.697366 31882 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:51.697444 31882 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fd9782e7ce64d65838845b123664993, State: Initialized, Role: FOLLOWER
I20260809 00:45:51.697993 31882 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd9782e7ce64d65838845b123664993" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42199 } }
I20260809 00:45:51.698227 31882 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:45:51.698386 31882 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:45:51.698582 31882 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:51.700642 31882 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd9782e7ce64d65838845b123664993" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42199 } }
I20260809 00:45:51.701102 31882 leader_election.cc:302] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fd9782e7ce64d65838845b123664993; no voters:
I20260809 00:45:51.701619 31882 leader_election.cc:288] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:45:51.701754 31889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:51.702535 31889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [term 1 LEADER]: Becoming Leader. State: Replica: 8fd9782e7ce64d65838845b123664993, State: Running, Role: LEADER
I20260809 00:45:51.703032 31889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd9782e7ce64d65838845b123664993" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42199 } }
I20260809 00:45:51.703971 31882 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:45:51.705888 31890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fd9782e7ce64d65838845b123664993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd9782e7ce64d65838845b123664993" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42199 } } }
I20260809 00:45:51.706324 31890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:51.707180 31891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fd9782e7ce64d65838845b123664993. Latest consensus state: current_term: 1 leader_uuid: "8fd9782e7ce64d65838845b123664993" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fd9782e7ce64d65838845b123664993" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42199 } } }
I20260809 00:45:51.707500 31891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993 [sys.catalog]: This master's current role is: LEADER
I20260809 00:45:51.707929 31902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:45:51.713127 31902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:45:51.721208 31902 catalog_manager.cc:1347] Generated new cluster ID: eb06a5c177a440c198db893630f718e5
I20260809 00:45:51.721316 31902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:45:51.752004 31902 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:45:51.753386 31902 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:45:51.764161 31902 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Generated new TSK 0
I20260809 00:45:51.764922 31902 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:45:51.813336 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:42199
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:52.138852 31918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:52.139143 31918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:52.139292 31918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:52.146457 31918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:52.146565 31918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:52.146692 31918 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 00:45:52.146760 31918 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:45:52.146862 31918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:45:52.156582 31918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:42199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:52.157896 31918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:52.159271 31918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:52.171875 31924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:52.171916 31928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:52.171948 31932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:52.172693 31918 server_base.cc:1034] running on GCE node
I20260809 00:45:52.173257 31918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:52.174185 31918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:52.175385 31918 hybrid_clock.cc:648] HybridClock initialized: now 1786236352175335 us; error 39 us; skew 500 ppm
I20260809 00:45:52.175722 31918 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:52 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236352, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:52.178880 31918 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:45:52.180294 31918 webserver.cc:460] Webserver started at http://127.28.92.129:40479/ using document root <none> and password file <none>
I20260809 00:45:52.180979 31918 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:52.181103 31918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:52.181411 31918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:52.184490 31918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "f5e594b237a040679b062f0e1d718306"
format_stamp: "Formatted at 2026-08-09 00:45:52 on dist-test-slave-t7g5"
server_key: "1c4c0c5bd22271adba2e6ba698e2342d"
server_key_iv: "3291f2435eee769b68184cf09993c880"
server_key_version: "encryptionkey@0"
I20260809 00:45:52.185269 31918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "f5e594b237a040679b062f0e1d718306"
format_stamp: "Formatted at 2026-08-09 00:45:52 on dist-test-slave-t7g5"
server_key: "1c4c0c5bd22271adba2e6ba698e2342d"
server_key_iv: "3291f2435eee769b68184cf09993c880"
server_key_version: "encryptionkey@0"
I20260809 00:45:52.191184 31918 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.002s
I20260809 00:45:52.196302 31944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:52.198949 31918 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260809 00:45:52.199203 31918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "f5e594b237a040679b062f0e1d718306"
format_stamp: "Formatted at 2026-08-09 00:45:52 on dist-test-slave-t7g5"
server_key: "1c4c0c5bd22271adba2e6ba698e2342d"
server_key_iv: "3291f2435eee769b68184cf09993c880"
server_key_version: "encryptionkey@0"
I20260809 00:45:52.199497 31918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:52.220613 31918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:52.226181 31918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:52.226461 31918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:52.229245 31918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:52.229369 31918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:52.229511 31918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:52.229671 31918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 00:45:52 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236352, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:52.250871 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.229702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:59551 (local address 127.28.92.190:42199)
0809 00:45:52.230170 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:52.230177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:52.231338 (+ 1161us) server_negotiation.cc:407] Connection header received
0809 00:45:52.233405 (+ 2067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:52.233412 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:52.233528 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:52.233685 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:52.235799 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.236925 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.239278 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.239942 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.240083 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.244289 (+ 4206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:52.244294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:52.244297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:52.244331 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:52.247083 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.248025 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.248031 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.248034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.248192 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.248846 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.248851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.248855 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.249201 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:52.249317 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:52.250410 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0809 00:45:52.250620 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":240,"threads_started":1}
I20260809 00:45:52.252512 31961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.230392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.28.92.129:59551)
0809 00:45:52.231175 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:52.231223 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:52.233042 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:52.233903 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:52.233918 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:52.234679 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:52.235601 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.235625 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.237113 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.237118 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.239111 (+ 1993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.239128 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.240210 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.240219 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.240410 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.241024 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:52.241047 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:52.244041 (+ 2994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:52.247261 (+ 3220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.247275 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.247292 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.247894 (+ 602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.248343 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.248348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.248351 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.248690 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.249313 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:52.249322 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:52.249910 (+ 588us) client_negotiation.cc:769] Sending connection context
0809 00:45:52.250278 (+ 368us) client_negotiation.cc:240] Negotiation successful
0809 00:45:52.250905 (+ 627us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":329,"threads_started":1}
I20260809 00:45:52.272858 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.258988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:59111 (local address 127.28.92.190:42199)
0809 00:45:52.259164 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:52.259169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:52.259797 (+ 628us) server_negotiation.cc:407] Connection header received
0809 00:45:52.259954 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:52.259959 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:52.260021 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:52.260100 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:52.261024 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.261772 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.263879 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.264335 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.264490 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.266684 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:52.266689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:52.266692 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:52.266728 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:52.269834 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.270675 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.270681 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.270684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.270855 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.271266 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.271272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.271276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.271667 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:52.271818 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:52.272293 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 00:45:52.272535 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:45:52.272933 32057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.259076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.28.92.129:59111)
0809 00:45:52.259694 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:52.259713 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:52.259841 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:52.260138 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:52.260142 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:52.260600 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:52.260880 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.260889 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.261920 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.261924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.263679 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.263699 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.264708 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.264713 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.264840 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.265462 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:52.265478 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:52.266500 (+ 1022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:52.269961 (+ 3461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.269964 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.269967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.270506 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.270963 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.270968 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.270970 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.271113 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.271821 (+ 708us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:52.271830 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:52.272021 (+ 191us) client_negotiation.cc:769] Sending connection context
0809 00:45:52.272161 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 00:45:52.272481 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":351,"threads_started":1}
I20260809 00:45:52.283900 31918 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:43325
I20260809 00:45:52.283948 32136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:43325 every 8 connection(s)
I20260809 00:45:52.285288 31918 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:45:52.287439 32138 heartbeater.cc:347] Connected to a master server at 127.28.92.190:42199
I20260809 00:45:52.287699 32138 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:52.288400 32138 heartbeater.cc:511] Master 127.28.92.190:42199 requested a full tablet report, sending...
I20260809 00:45:52.290637 31803 ts_manager.cc:194] Registered new tserver with Master: f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325)
I20260809 00:45:52.292193 31803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:59551
I20260809 00:45:52.295262 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31918
I20260809 00:45:52.295444 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:45:52.296116 29042 external_mini_cluster.cc:1428] Setting key 36662671f8085b879004418cb2c81e07
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:45:52.339152 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:42199
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:52.659952 32144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:52.660243 32144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:52.660395 32144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:52.667507 32144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:52.667623 32144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:52.667754 32144 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 00:45:52.667824 32144 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:45:52.667927 32144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:45:52.677464 32144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:42199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:52.678678 32144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:52.679955 32144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:52.692754 32152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:52.692790 32153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:52.692812 32158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:52.693553 32144 server_base.cc:1034] running on GCE node
I20260809 00:45:52.694231 32144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:52.695205 32144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:52.696411 32144 hybrid_clock.cc:648] HybridClock initialized: now 1786236352696356 us; error 41 us; skew 500 ppm
I20260809 00:45:52.696720 32144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:52 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236352, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:52.699757 32144 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:45:52.701156 32144 webserver.cc:460] Webserver started at http://127.28.92.130:46843/ using document root <none> and password file <none>
I20260809 00:45:52.701857 32144 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:52.701979 32144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:52.702276 32144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:52.705319 32144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "3a02544eb003401d995a18ab9684048a"
format_stamp: "Formatted at 2026-08-09 00:45:52 on dist-test-slave-t7g5"
server_key: "eaedc00a60d52194448b58c810847038"
server_key_iv: "507b9b80303543c6f0a6a36bb48db72a"
server_key_version: "encryptionkey@0"
I20260809 00:45:52.706151 32144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "3a02544eb003401d995a18ab9684048a"
format_stamp: "Formatted at 2026-08-09 00:45:52 on dist-test-slave-t7g5"
server_key: "eaedc00a60d52194448b58c810847038"
server_key_iv: "507b9b80303543c6f0a6a36bb48db72a"
server_key_version: "encryptionkey@0"
I20260809 00:45:52.711458 32144 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:45:52.714844 32168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:52.716123 32144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 00:45:52.716276 32144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "3a02544eb003401d995a18ab9684048a"
format_stamp: "Formatted at 2026-08-09 00:45:52 on dist-test-slave-t7g5"
server_key: "eaedc00a60d52194448b58c810847038"
server_key_iv: "507b9b80303543c6f0a6a36bb48db72a"
server_key_version: "encryptionkey@0"
I20260809 00:45:52.716455 32144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:52.740981 32144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:52.744675 32144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:52.744956 32144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:52.747615 32144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:52.747721 32144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:52.747857 32144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:52.747943 32144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:45:52 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236352, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:52.770052 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.748007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:39585 (local address 127.28.92.190:42199)
0809 00:45:52.748212 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:52.748220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:52.749636 (+ 1416us) server_negotiation.cc:407] Connection header received
0809 00:45:52.751649 (+ 2013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:52.751656 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:52.751777 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:52.751894 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:52.753970 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.755015 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.757580 (+ 2565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.758262 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.758405 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.763281 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:52.763287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:52.763290 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:52.763323 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:52.766165 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.767126 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.767130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.767132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.767263 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.767787 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.767793 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.767797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.768153 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:52.768302 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:52.769390 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0809 00:45:52.769693 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:45:52.771032 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.748610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.28.92.130:39585)
0809 00:45:52.749446 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:52.749504 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:52.751364 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:52.752132 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:52.752143 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:52.752836 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:52.753776 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.753811 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.755181 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.755186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.757405 (+ 2219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.757421 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.758536 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.758545 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.758871 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.759703 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:52.759740 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:52.763029 (+ 3289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:52.766310 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.766321 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.766339 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.766993 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.767379 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.767384 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.767388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.767675 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.768374 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:52.768381 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:52.768895 (+ 514us) client_negotiation.cc:769] Sending connection context
0809 00:45:52.769224 (+ 329us) client_negotiation.cc:240] Negotiation successful
0809 00:45:52.769710 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":345,"threads_started":1}
I20260809 00:45:52.793095 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.776541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:42317 (local address 127.28.92.190:42199)
0809 00:45:52.776738 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:52.776744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:52.777309 (+ 565us) server_negotiation.cc:407] Connection header received
0809 00:45:52.777602 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:52.777608 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:52.777716 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:52.777793 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:52.779503 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.780636 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.783032 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.783516 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.783658 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.786010 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:52.786018 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:52.786022 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:52.786057 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:52.789373 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.790393 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.790399 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.790402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.790590 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:52.791065 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:52.791072 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:52.791076 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:52.791571 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:52.791726 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:52.792445 (+ 719us) server_negotiation.cc:299] Negotiation successful
0809 00:45:52.792704 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:45:52.793234 32272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:52.776519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.28.92.130:42317)
0809 00:45:52.777191 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:52.777213 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:52.777433 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:52.778011 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:52.778017 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:52.778736 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:52.779302 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.779321 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.780859 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.780865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.782839 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:52.782860 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:52.783741 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:52.783748 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:52.783936 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:52.784578 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:52.784602 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:52.785754 (+ 1152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:52.789530 (+ 3776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.789541 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.789546 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.790249 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.790743 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:52.790749 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:52.790753 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:52.790922 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:52.791794 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:52.791800 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:52.792067 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 00:45:52.792292 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 00:45:52.792704 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":348,"threads_started":1}
I20260809 00:45:52.800493 32144 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:34285
I20260809 00:45:52.800534 32364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:34285 every 8 connection(s)
I20260809 00:45:52.801728 32144 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:45:52.803730 32366 heartbeater.cc:347] Connected to a master server at 127.28.92.190:42199
I20260809 00:45:52.803992 32366 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:52.804636 32366 heartbeater.cc:511] Master 127.28.92.190:42199 requested a full tablet report, sending...
I20260809 00:45:52.806262 31803 ts_manager.cc:194] Registered new tserver with Master: 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285)
I20260809 00:45:52.807384 31803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:39585
I20260809 00:45:52.808110 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 32144
I20260809 00:45:52.808305 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:45:52.808900 29042 external_mini_cluster.cc:1428] Setting key c0c7ea204aff0bbe6ea172e23aae5a12
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:45:52.862293 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:42199
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:38721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:45:53.184689 32371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:45:53.184980 32371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:45:53.185092 32371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:45:53.192401 32371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:45:53.192521 32371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:45:53.192615 32371 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 00:45:53.192669 32371 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:45:53.192737 32371 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:45:53.203603 32371 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:38721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:42199
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:45:53.205011 32371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:45:53.206472 32371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:45:53.219275 32378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:53.219360 32377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:45:53.219319 32381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:45:53.220094 32371 server_base.cc:1034] running on GCE node
I20260809 00:45:53.220696 32371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:45:53.221637 32371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:45:53.222869 32371 hybrid_clock.cc:648] HybridClock initialized: now 1786236353222811 us; error 52 us; skew 500 ppm
I20260809 00:45:53.223170 32371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:45:53 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236353, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:45:53.226176 32371 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:45:53.227598 32371 webserver.cc:460] Webserver started at http://127.28.92.131:42289/ using document root <none> and password file <none>
I20260809 00:45:53.228329 32371 fs_manager.cc:359] Metadata directory not provided
I20260809 00:45:53.228466 32371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:45:53.228772 32371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:45:53.231670 32371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "cb74ecd0c2224858bbd5eacc3d900ab8"
format_stamp: "Formatted at 2026-08-09 00:45:53 on dist-test-slave-t7g5"
server_key: "9c252afaaff47f4705fd9d6d41082983"
server_key_iv: "731af1060923813e71305f8d68bc93fa"
server_key_version: "encryptionkey@0"
I20260809 00:45:53.232407 32371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "cb74ecd0c2224858bbd5eacc3d900ab8"
format_stamp: "Formatted at 2026-08-09 00:45:53 on dist-test-slave-t7g5"
server_key: "9c252afaaff47f4705fd9d6d41082983"
server_key_iv: "731af1060923813e71305f8d68bc93fa"
server_key_version: "encryptionkey@0"
I20260809 00:45:53.237396 32371 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:45:53.240690 32391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:53.241936 32371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:53.242089 32371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "cb74ecd0c2224858bbd5eacc3d900ab8"
format_stamp: "Formatted at 2026-08-09 00:45:53 on dist-test-slave-t7g5"
server_key: "9c252afaaff47f4705fd9d6d41082983"
server_key_iv: "731af1060923813e71305f8d68bc93fa"
server_key_version: "encryptionkey@0"
I20260809 00:45:53.242264 32371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:45:53.253328 32371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:45:53.257026 32371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:45:53.257275 32371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:45:53.259796 32371 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:45:53.259919 32371 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:45:53.260038 32371 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:45:53.260121 32371 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:45:53 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236353, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:53.281175 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.260248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:36405 (local address 127.28.92.190:42199)
0809 00:45:53.260487 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.260495 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.261643 (+ 1148us) server_negotiation.cc:407] Connection header received
0809 00:45:53.263632 (+ 1989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.263638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.263730 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.263859 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:53.265941 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.266904 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.269339 (+ 2435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.269801 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.269907 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.274480 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:53.274485 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:53.274489 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:53.274522 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:53.277209 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.278224 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.278230 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.278233 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.278403 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.278999 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.279004 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.279007 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.279309 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:53.279456 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.280648 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.280915 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:45:53.282908 32405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.260667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.28.92.131:36405)
0809 00:45:53.261467 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.261516 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.263355 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.264117 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.264131 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.264873 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:53.265702 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.265734 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.267056 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.267062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.269206 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.269217 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.270043 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.270052 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.270245 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.270966 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:53.271002 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:53.274272 (+ 3270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:53.277348 (+ 3076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:53.277359 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:53.277375 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:53.278080 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:53.278542 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:53.278551 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:53.278554 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:53.278847 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:53.279462 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:53.279471 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:53.279995 (+ 524us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.280513 (+ 518us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.281095 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":324,"threads_started":1}
I20260809 00:45:53.295248 32138 heartbeater.cc:503] Master 127.28.92.190:42199 was elected leader, sending a full tablet report...
I20260809 00:45:53.301854 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.288239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:53355 (local address 127.28.92.190:42199)
0809 00:45:53.288405 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.288411 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.288873 (+ 462us) server_negotiation.cc:407] Connection header received
0809 00:45:53.289121 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.289127 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.289195 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.289273 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:53.290409 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.291431 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.293209 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.293635 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.293770 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.295562 (+ 1792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:53.295566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:53.295569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:53.295602 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:53.298774 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.299635 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.299641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.299645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.299818 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.300225 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.300231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.300235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.300606 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:53.300752 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.301262 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.301480 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 00:45:53.302047 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.288167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.28.92.131:53355)
0809 00:45:53.288743 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.288767 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.288923 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.289321 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.289325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.289790 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:53.290196 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.290214 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.291619 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.291627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.293077 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.293090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.293836 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.293842 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.294016 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.294633 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:53.294649 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:53.295340 (+ 691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:53.298896 (+ 3556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:53.298902 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:53.298906 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:53.299454 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:53.299959 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:53.299968 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:53.299972 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:53.300110 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:53.300729 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:53.300734 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:53.300971 (+ 237us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.301159 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.301514 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":299,"threads_started":1}
I20260809 00:45:53.314208 32371 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:45141
I20260809 00:45:53.314254 32583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:45141 every 8 connection(s)
I20260809 00:45:53.315448 32371 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:45:53.317463 32585 heartbeater.cc:347] Connected to a master server at 127.28.92.190:42199
I20260809 00:45:53.317677 32585 heartbeater.cc:464] Registering TS with master...
I20260809 00:45:53.318300 32585 heartbeater.cc:511] Master 127.28.92.190:42199 requested a full tablet report, sending...
I20260809 00:45:53.319577 31803 ts_manager.cc:194] Registered new tserver with Master: cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:53.320408 31803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:36405
I20260809 00:45:53.322834 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 32371
I20260809 00:45:53.322984 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:45:53.323390 29042 external_mini_cluster.cc:1428] Setting key b60f00d085de556d2fd7b7476b2203a9
I20260809 00:45:53.325932 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 00:45:53 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 00:45:53 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:53.373808 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.360889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45292 (local address 127.28.92.190:42199)
0809 00:45:53.361117 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.361124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.361304 (+ 180us) server_negotiation.cc:407] Connection header received
0809 00:45:53.361458 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.361463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.361528 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.361614 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:53.362950 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.363695 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.364873 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.365289 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.365376 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.369069 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:53.369075 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:53.369078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:53.369112 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:53.371436 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.371986 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.371990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.371992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.372115 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.372458 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.372465 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.372469 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.372812 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:53.373035 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.373256 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.373433 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 00:45:53.377596 31803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:45:53.384744 31803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:53.406220 32608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.396896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34285 (local address 127.0.0.1:60118)
0809 00:45:53.397819 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.397860 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.397991 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.398914 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.398922 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.398953 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.399326 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.399341 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.401173 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.401177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.403225 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.403241 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.405045 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.405056 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.405359 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.405418 (+ 59us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.405552 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.405773 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":673,"mutex_wait_us":1,"thread_start_us":490,"threads_started":1}
I20260809 00:45:53.406291 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.397166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60118 (local address 127.28.92.130:34285)
0809 00:45:53.398013 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.398021 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.398051 (+ 30us) server_negotiation.cc:407] Connection header received
0809 00:45:53.398171 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.398178 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.398434 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.398660 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.399560 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.401006 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.403405 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.404822 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.404963 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.405174 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.405815 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.405991 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":288,"threads_started":1}
I20260809 00:45:53.406853 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.398220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45141 (local address 127.0.0.1:41560)
0809 00:45:53.398744 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.398763 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.398885 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.400000 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.400004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.400030 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.400504 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.400517 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.402436 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.402440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.404127 (+ 1687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.404143 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.406115 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.406122 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.406296 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.406328 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.406395 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.406522 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":262,"threads_started":1}
I20260809 00:45:53.408090 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.398587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.28.92.131:45141)
0809 00:45:53.399462 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.399470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.399502 (+ 32us) server_negotiation.cc:407] Connection header received
0809 00:45:53.399601 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.399609 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.399823 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.400009 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.400748 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.402323 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.404369 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.405861 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.407344 (+ 1483us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.407590 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.407674 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.407819 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":544,"threads_started":1}
I20260809 00:45:53.408922 32612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.398788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43325 (local address 127.0.0.1:38612)
0809 00:45:53.400706 (+ 1918us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.400727 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.400837 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.401707 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.401712 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.401737 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.402178 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.402189 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.404213 (+ 2024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.404218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.406230 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.406244 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.408376 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.408383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.408522 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.408545 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.408611 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.408699 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1799,"thread_start_us":1631,"threads_started":1}
I20260809 00:45:53.409626 32614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.399258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38612 (local address 127.28.92.129:43325)
0809 00:45:53.399771 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.399779 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.400977 (+ 1198us) server_negotiation.cc:407] Connection header received
0809 00:45:53.401081 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.401089 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.401301 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.401476 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.402366 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.404016 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.406557 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.407925 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.408060 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.409211 (+ 1151us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.409267 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.409403 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":226,"threads_started":1}
I20260809 00:45:53.411005 32244 tablet_service.cc:1467] Processing CreateTablet for tablet e75e0d0ec328477bb60d06690d3a79d5 (DEFAULT_TABLE table=test-table [id=6e32e73f4fa74f72a3d190405d8ba431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:53.411686 32477 tablet_service.cc:1467] Processing CreateTablet for tablet e75e0d0ec328477bb60d06690d3a79d5 (DEFAULT_TABLE table=test-table [id=6e32e73f4fa74f72a3d190405d8ba431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:53.412600 32244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75e0d0ec328477bb60d06690d3a79d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:53.412591 32025 tablet_service.cc:1467] Processing CreateTablet for tablet e75e0d0ec328477bb60d06690d3a79d5 (DEFAULT_TABLE table=test-table [id=6e32e73f4fa74f72a3d190405d8ba431]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:53.413130 32477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75e0d0ec328477bb60d06690d3a79d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:53.413846 32025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e75e0d0ec328477bb60d06690d3a79d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:53.425029 32618 tablet_bootstrap.cc:492] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Bootstrap starting.
I20260809 00:45:53.427258 32619 tablet_bootstrap.cc:492] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Bootstrap starting.
I20260809 00:45:53.428823 32618 tablet_bootstrap.cc:654] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:53.430166 32618 log.cc:824] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:53.430677 32619 tablet_bootstrap.cc:654] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:53.431932 32619 log.cc:824] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:53.433791 32620 tablet_bootstrap.cc:492] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Bootstrap starting.
I20260809 00:45:53.435320 32619 tablet_bootstrap.cc:492] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: No bootstrap required, opened a new log
I20260809 00:45:53.435636 32619 ts_tablet_manager.cc:1397] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 00:45:53.436374 32620 tablet_bootstrap.cc:654] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:53.437516 32620 log.cc:824] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Log is configured to *not* fsync() on all Append() calls
I20260809 00:45:53.440991 32618 tablet_bootstrap.cc:492] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: No bootstrap required, opened a new log
I20260809 00:45:53.441269 32618 ts_tablet_manager.cc:1397] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20260809 00:45:53.441358 32620 tablet_bootstrap.cc:492] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: No bootstrap required, opened a new log
I20260809 00:45:53.441598 32620 ts_tablet_manager.cc:1397] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20260809 00:45:53.445853 32619 raft_consensus.cc:348] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.446296 32619 raft_consensus.cc:374] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:53.446389 32619 raft_consensus.cc:729] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Initialized, Role: FOLLOWER
I20260809 00:45:53.447139 32619 consensus_queue.cc:260] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.448268 32585 heartbeater.cc:503] Master 127.28.92.190:42199 was elected leader, sending a full tablet report...
I20260809 00:45:53.448897 32619 ts_tablet_manager.cc:1428] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260809 00:45:53.449369 32620 raft_consensus.cc:348] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.449817 32620 raft_consensus.cc:374] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:53.449936 32620 raft_consensus.cc:729] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a02544eb003401d995a18ab9684048a, State: Initialized, Role: FOLLOWER
I20260809 00:45:53.450555 32620 consensus_queue.cc:260] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.450839 32618 raft_consensus.cc:348] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.451241 32618 raft_consensus.cc:374] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:53.451346 32618 raft_consensus.cc:729] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e594b237a040679b062f0e1d718306, State: Initialized, Role: FOLLOWER
I20260809 00:45:53.451756 32366 heartbeater.cc:503] Master 127.28.92.190:42199 was elected leader, sending a full tablet report...
I20260809 00:45:53.451915 32618 consensus_queue.cc:260] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.452244 32620 ts_tablet_manager.cc:1428] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
I20260809 00:45:53.453823 32618 ts_tablet_manager.cc:1428] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Time spent starting tablet: real 0.012s user 0.013s sys 0.002s
W20260809 00:45:53.537645 32140 tablet.cc:2369] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:45:53.553563 32368 tablet.cc:2369] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:45:53.566993 32586 tablet.cc:2369] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:45:53.769578 32629 raft_consensus.cc:482] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:53.769955 32629 raft_consensus.cc:504] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.772841 32629 leader_election.cc:288] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285), cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:53.779784 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.773122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:40991 (local address 127.28.92.130:34285)
0809 00:45:53.773319 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.773323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.773960 (+ 637us) server_negotiation.cc:407] Connection header received
0809 00:45:53.774302 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.774308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.774406 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.774472 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.775324 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.776098 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.778077 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.778840 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.778973 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.779036 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.779383 (+ 347us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.779519 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 00:45:53.779798 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.774158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:38185 (local address 127.28.92.131:45141)
0809 00:45:53.774338 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.774343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.774567 (+ 224us) server_negotiation.cc:407] Connection header received
0809 00:45:53.774688 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.774693 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.774765 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.774855 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.775395 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.776095 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.778069 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.778943 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.779101 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.779173 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.779428 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.779561 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 00:45:53.779906 32631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.773152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34285 (local address 127.28.92.129:40991)
0809 00:45:53.773845 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.773865 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.774095 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.774680 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.774684 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.774711 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.775157 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.775172 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.776243 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.776248 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.777912 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.777924 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.779036 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.779042 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.779207 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.779247 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.779323 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.779440 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":34,"thread_start_us":335,"threads_started":1}
I20260809 00:45:53.780293 32633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.773892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45141 (local address 127.28.92.129:38185)
0809 00:45:53.774468 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.774482 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.774588 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.774870 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.774873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.774891 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.775246 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.775256 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.776229 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.776233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.777918 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.777930 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.779153 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.779157 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.779278 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.779301 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.779392 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.779518 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":39,"thread_start_us":289,"threads_started":1}
I20260809 00:45:53.781076 32283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75e0d0ec328477bb60d06690d3a79d5" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a" is_pre_election: true
I20260809 00:45:53.781260 32513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75e0d0ec328477bb60d06690d3a79d5" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" is_pre_election: true
I20260809 00:45:53.781760 32513 raft_consensus.cc:2454] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 0.
I20260809 00:45:53.781760 32283 raft_consensus.cc:2454] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 0.
I20260809 00:45:53.782428 31953 leader_election.cc:302] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, f5e594b237a040679b062f0e1d718306; no voters:
I20260809 00:45:53.782799 32629 raft_consensus.cc:2781] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:53.782984 32629 raft_consensus.cc:482] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:53.783685 32629 raft_consensus.cc:3037] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:53.786158 32629 raft_consensus.cc:504] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.786754 32629 leader_election.cc:288] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 election: Requested vote from peers 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285), cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:53.787206 32283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75e0d0ec328477bb60d06690d3a79d5" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a"
I20260809 00:45:53.787302 32513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e75e0d0ec328477bb60d06690d3a79d5" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8"
I20260809 00:45:53.787393 32283 raft_consensus.cc:3037] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:53.787523 32513 raft_consensus.cc:3037] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:53.789721 32283 raft_consensus.cc:2454] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 1.
I20260809 00:45:53.790122 31953 leader_election.cc:302] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, f5e594b237a040679b062f0e1d718306; no voters:
I20260809 00:45:53.790390 32629 raft_consensus.cc:2781] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:53.790541 32513 raft_consensus.cc:2454] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 1.
I20260809 00:45:53.790880 32629 raft_consensus.cc:686] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 1 LEADER]: Becoming Leader. State: Replica: f5e594b237a040679b062f0e1d718306, State: Running, Role: LEADER
I20260809 00:45:53.791617 32629 consensus_queue.cc:237] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } }
I20260809 00:45:53.796559 31803 catalog_manager.cc:5495] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5e594b237a040679b062f0e1d718306 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "f5e594b237a040679b062f0e1d718306" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } health_report { overall_health: HEALTHY } } }
Aug 09 00:45:53 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236351, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:53.908094 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.891920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:42199 (local address 127.0.0.1:59748)
0809 00:45:53.892674 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.892695 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.892828 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.893136 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.893139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.893908 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:45:53.894180 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.894190 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.895288 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.895292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.896260 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.896271 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.896970 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.896974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.897100 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.900354 (+ 3254us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:45:53.900378 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:45:53.902687 (+ 2309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:45:53.905607 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:53.905620 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:53.905626 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:53.906110 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:53.906487 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:45:53.906490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:45:53.906492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:45:53.906641 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:45:53.907237 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:45:53.907249 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:45:53.907439 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.907578 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.907806 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":369,"threads_started":1}
I20260809 00:45:53.908329 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.891914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.28.92.190:42199)
0809 00:45:53.892707 (+ 793us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.892711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.892755 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:45:53.892924 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.892928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.892994 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.893100 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:53.894335 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.895167 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.896379 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.896801 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.896892 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.902934 (+ 6042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:53.902940 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:53.902944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:53.902977 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:53.905485 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.906223 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.906228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.906231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.906374 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:53.906737 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:53.906741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:53.906743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:53.907049 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:53.907202 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.907673 (+ 471us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.907970 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":657,"thread_start_us":420,"threads_started":1}
I20260809 00:45:53.913349 31803 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:59748:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 00:45:53.914332 31803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:53.920918 32025 tablet_service.cc:1467] Processing CreateTablet for tablet 0b1d160bf4994d42adfc60538c4b4f1d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dea3bc7431194129a7f1dd9432a3dce5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:45:53.921033 32244 tablet_service.cc:1467] Processing CreateTablet for tablet 0b1d160bf4994d42adfc60538c4b4f1d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dea3bc7431194129a7f1dd9432a3dce5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:45:53.921888 32025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b1d160bf4994d42adfc60538c4b4f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:53.921890 32244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b1d160bf4994d42adfc60538c4b4f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:53.926107 32477 tablet_service.cc:1467] Processing CreateTablet for tablet 0b1d160bf4994d42adfc60538c4b4f1d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dea3bc7431194129a7f1dd9432a3dce5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:45:53.927117 32477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b1d160bf4994d42adfc60538c4b4f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:53.927362 32618 tablet_bootstrap.cc:492] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: Bootstrap starting.
I20260809 00:45:53.928337 32620 tablet_bootstrap.cc:492] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: Bootstrap starting.
I20260809 00:45:53.928793 32618 tablet_bootstrap.cc:654] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:53.929984 32620 tablet_bootstrap.cc:654] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:53.930968 32618 tablet_bootstrap.cc:492] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: No bootstrap required, opened a new log
I20260809 00:45:53.931197 32618 ts_tablet_manager.cc:1397] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.002s
I20260809 00:45:53.932036 32618 raft_consensus.cc:348] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.932246 32618 raft_consensus.cc:374] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:53.932341 32618 raft_consensus.cc:729] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e594b237a040679b062f0e1d718306, State: Initialized, Role: FOLLOWER
I20260809 00:45:53.932580 32618 consensus_queue.cc:260] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.932734 32620 tablet_bootstrap.cc:492] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: No bootstrap required, opened a new log
I20260809 00:45:53.932878 32620 ts_tablet_manager.cc:1397] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 00:45:53.932955 32629 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:53.933228 32629 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:53.933573 32620 raft_consensus.cc:348] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.933771 32618 ts_tablet_manager.cc:1428] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 00:45:53.933849 32620 raft_consensus.cc:374] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:53.933964 32620 raft_consensus.cc:729] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a02544eb003401d995a18ab9684048a, State: Initialized, Role: FOLLOWER
I20260809 00:45:53.934212 32620 consensus_queue.cc:260] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.934940 32620 ts_tablet_manager.cc:1428] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 00:45:53.934717 32628 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:53.935106 32628 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:53.935149 32619 tablet_bootstrap.cc:492] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: Bootstrap starting.
I20260809 00:45:53.936765 32619 tablet_bootstrap.cc:654] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:53.939270 32619 tablet_bootstrap.cc:492] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: No bootstrap required, opened a new log
I20260809 00:45:53.939410 32619 ts_tablet_manager.cc:1397] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260809 00:45:53.939992 32619 raft_consensus.cc:348] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.940479 32619 raft_consensus.cc:374] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:53.940594 32619 raft_consensus.cc:729] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Initialized, Role: FOLLOWER
I20260809 00:45:53.940828 32619 consensus_queue.cc:260] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.941335 32619 ts_tablet_manager.cc:1428] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 00:45:53.941296 32626 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:53.941601 32626 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:53.982651 32628 raft_consensus.cc:482] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:53.982875 32628 raft_consensus.cc:504] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:53.984510 32628 leader_election.cc:288] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325), cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:53.991799 32611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.985881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:33937 (local address 127.28.92.131:45141)
0809 00:45:53.986065 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.986073 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.986464 (+ 391us) server_negotiation.cc:407] Connection header received
0809 00:45:53.986593 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.986598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.986675 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.986763 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.987345 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.988247 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.990051 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.990857 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.990976 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.991046 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.991395 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.991531 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:45:53.991865 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.984873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:53541 (local address 127.28.92.129:43325)
0809 00:45:53.985377 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:53.985383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:53.985697 (+ 314us) server_negotiation.cc:407] Connection header received
0809 00:45:53.985951 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:53.985956 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:53.986035 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:53.986147 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:53.986811 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.987725 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.990119 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.990921 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.991098 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.991171 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:53.991450 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 00:45:53.991590 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":249,"threads_started":1}
I20260809 00:45:53.991921 32663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.985742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45141 (local address 127.28.92.130:33937)
0809 00:45:53.986355 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.986369 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.986480 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.986789 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.986793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.986817 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.987178 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.987190 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.988390 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.988394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.989895 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.989908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.991068 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.991075 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.991245 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.991269 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.991342 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.991473 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":3,"thread_start_us":300,"threads_started":1}
I20260809 00:45:53.992118 32657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:53.984841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43325 (local address 127.28.92.130:53541)
0809 00:45:53.985576 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:53.985595 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:53.985752 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:53.986183 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:53.986188 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:53.986222 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:53.986611 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.986624 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.987864 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.987869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.989957 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:53.989972 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:53.991160 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:53.991165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:53.991295 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:53.991318 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:45:53.991411 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 00:45:53.991537 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"mutex_wait_us":45,"thread_start_us":453,"threads_started":1}
I20260809 00:45:53.992625 32513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d160bf4994d42adfc60538c4b4f1d" candidate_uuid: "3a02544eb003401d995a18ab9684048a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" is_pre_election: true
I20260809 00:45:53.992885 32513 raft_consensus.cc:2454] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a02544eb003401d995a18ab9684048a in term 0.
I20260809 00:45:53.992969 32067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d160bf4994d42adfc60538c4b4f1d" candidate_uuid: "3a02544eb003401d995a18ab9684048a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e594b237a040679b062f0e1d718306" is_pre_election: true
I20260809 00:45:53.993356 32173 leader_election.cc:302] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, cb74ecd0c2224858bbd5eacc3d900ab8; no voters:
I20260809 00:45:53.993419 32067 raft_consensus.cc:2454] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a02544eb003401d995a18ab9684048a in term 0.
I20260809 00:45:53.993759 32628 raft_consensus.cc:2781] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:53.993898 32628 raft_consensus.cc:482] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:53.994019 32628 raft_consensus.cc:3037] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:54.068336 32628 raft_consensus.cc:504] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.069203 32628 leader_election.cc:288] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [CANDIDATE]: Term 1 election: Requested vote from peers f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325), cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:54.069919 32067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d160bf4994d42adfc60538c4b4f1d" candidate_uuid: "3a02544eb003401d995a18ab9684048a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e594b237a040679b062f0e1d718306"
I20260809 00:45:54.069959 32513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b1d160bf4994d42adfc60538c4b4f1d" candidate_uuid: "3a02544eb003401d995a18ab9684048a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8"
I20260809 00:45:54.070163 32067 raft_consensus.cc:3037] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:54.070192 32513 raft_consensus.cc:3037] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:54.173105 32067 raft_consensus.cc:2454] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a02544eb003401d995a18ab9684048a in term 1.
I20260809 00:45:54.173141 32513 raft_consensus.cc:2454] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a02544eb003401d995a18ab9684048a in term 1.
I20260809 00:45:54.173826 32173 leader_election.cc:302] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, cb74ecd0c2224858bbd5eacc3d900ab8; no voters:
I20260809 00:45:54.174216 32628 raft_consensus.cc:2781] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:54.174734 32628 raft_consensus.cc:686] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [term 1 LEADER]: Becoming Leader. State: Replica: 3a02544eb003401d995a18ab9684048a, State: Running, Role: LEADER
I20260809 00:45:54.175354 32628 consensus_queue.cc:237] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.179848 32664 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: TxnStatusTablet state changed. Reason: New leader 3a02544eb003401d995a18ab9684048a. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.180198 32664 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:45:54.180896 32669 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 00:45:54.181206 32669 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 00:45:54.181780 31802 catalog_manager.cc:5495] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a02544eb003401d995a18ab9684048a (127.28.92.130). New cstate: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } health_report { overall_health: UNKNOWN } } }
I20260809 00:45:54.188249 32629 consensus_queue.cc:1035] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:54.200011 32629 consensus_queue.cc:1035] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:54.228228 32647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.222698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34285 (local address 127.0.0.1:33802)
0809 00:45:54.222980 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.222995 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.223130 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.223592 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.223596 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.223608 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:54.223784 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.223793 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.224843 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.224849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.225950 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.225966 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.226652 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.226658 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.226805 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.226867 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.227680 (+ 813us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.227702 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.227782 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.227936 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 00:45:54.228250 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.222702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.28.92.130:34285)
0809 00:45:54.222872 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.222878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.223062 (+ 184us) server_negotiation.cc:407] Connection header received
0809 00:45:54.223328 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.223332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.223427 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.223556 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.223909 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.224718 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.226076 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.226496 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.226609 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.227048 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.227573 (+ 525us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.227704 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.227805 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.227890 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 00:45:54.234912 32513 raft_consensus.cc:1261] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Refusing update from remote peer 3a02544eb003401d995a18ab9684048a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:54.235014 32067 raft_consensus.cc:1261] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Refusing update from remote peer 3a02544eb003401d995a18ab9684048a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:54.235633 32664 consensus_queue.cc:1035] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:54.235926 32628 consensus_queue.cc:1035] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:54.240399 32636 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: TxnStatusTablet state changed. Reason: New leader 3a02544eb003401d995a18ab9684048a. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.240821 32636 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:54.244153 32679 mvcc.cc:205] Tried to move back new op lower bound from 7316424106938220544 to 7316424106706993152. Current Snapshot: MvccSnapshot[applied={T|T < 7316424106938220544}]
I20260809 00:45:54.244802 32664 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.245092 32664 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:45:54.246367 32636 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.246582 32636 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P f5e594b237a040679b062f0e1d718306: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:54.248764 32673 mvcc.cc:205] Tried to move back new op lower bound from 7316424106938220544 to 7316424106706993152. Current Snapshot: MvccSnapshot[applied={T|T < 7316424106938220544 or (T in {7316424106938220544})}]
I20260809 00:45:54.254385 32626 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: TxnStatusTablet state changed. Reason: New leader 3a02544eb003401d995a18ab9684048a. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.254665 32626 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:54.256451 32628 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.256737 32628 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P 3a02544eb003401d995a18ab9684048a: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:45:54.262506 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.256026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33482 (local address 127.28.92.129:43325)
0809 00:45:54.256212 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.256218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.256821 (+ 603us) server_negotiation.cc:407] Connection header received
0809 00:45:54.257142 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.257147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.257243 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.257409 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.258075 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.258900 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.260447 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.260839 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.260944 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.261390 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.261946 (+ 556us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.262073 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.262164 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.262245 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:45:54.266216 32626 tablet_replica.cc:439] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a02544eb003401d995a18ab9684048a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } } }
I20260809 00:45:54.266464 32626 tablet_replica.cc:442] T 0b1d160bf4994d42adfc60538c4b4f1d P cb74ecd0c2224858bbd5eacc3d900ab8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:45:54.280582 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.275219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54883 (local address 127.28.92.130:34285)
0809 00:45:54.275416 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.275422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.275793 (+ 371us) server_negotiation.cc:407] Connection header received
0809 00:45:54.275965 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.275971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.276056 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.276151 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.276605 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.277354 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.278852 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.279292 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.279401 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.279859 (+ 458us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.279972 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.280053 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.280215 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.280305 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:45:54.281126 32702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.275046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34285 (local address 127.28.92.129:54883)
0809 00:45:54.275699 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.275715 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.275827 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.276156 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.276158 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.276167 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:54.276460 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.276467 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.277480 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.277484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.278717 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.278729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.279472 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.279478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.279598 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.279651 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.280067 (+ 416us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.280080 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.280773 (+ 693us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.280906 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":308,"threads_started":1}
I20260809 00:45:54.356207 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.336758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:39811 (local address 127.28.92.129:43325)
0809 00:45:54.336960 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.336967 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.348957 (+ 11990us) server_negotiation.cc:407] Connection header received
0809 00:45:54.349507 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.349513 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.349596 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.349713 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.350339 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.351537 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.353759 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.354511 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.354639 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.355325 (+ 686us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.355468 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.355546 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.355786 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.355875 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:45:54.357019 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.336276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43325 (local address 127.28.92.130:39811)
0809 00:45:54.348835 (+ 12559us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.348857 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.349319 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.349751 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.349756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.349770 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:54.350176 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.350189 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.351698 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.351704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.353599 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.353620 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.354799 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.354806 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.355035 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.355117 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.355638 (+ 521us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.355649 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.356406 (+ 757us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.356556 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12342,"thread_start_us":12705,"threads_started":1}
I20260809 00:45:54.397684 31803 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:54.397998 31803 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:54.402216 31803 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Sending DeleteTablet for 3 replicas of tablet e75e0d0ec328477bb60d06690d3a79d5
I20260809 00:45:54.403604 32477 tablet_service.cc:1514] Processing DeleteTablet for tablet e75e0d0ec328477bb60d06690d3a79d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:54 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:41560
I20260809 00:45:54.403600 32025 tablet_service.cc:1514] Processing DeleteTablet for tablet e75e0d0ec328477bb60d06690d3a79d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:54 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38612
I20260809 00:45:54.404747 32244 tablet_service.cc:1514] Processing DeleteTablet for tablet e75e0d0ec328477bb60d06690d3a79d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:54 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60118
I20260809 00:45:54.410143 31803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:45:54.412706 31803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:54.415040 32712 tablet_replica.cc:330] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: stopping tablet replica
I20260809 00:45:54.416215 32712 raft_consensus.cc:2229] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:45:54.417057 32712 raft_consensus.cc:2258] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:54.418205 32715 tablet_replica.cc:330] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: stopping tablet replica
I20260809 00:45:54.418711 32715 raft_consensus.cc:2229] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:54.419116 32715 raft_consensus.cc:2258] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:54.419615 32712 ts_tablet_manager.cc:1905] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:54.422093 32715 ts_tablet_manager.cc:1905] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:54.431294 32025 tablet_service.cc:1467] Processing CreateTablet for tablet 17bc51cb7cdf47ff8e3932bb833a1938 (DEFAULT_TABLE table=test-table [id=c2f6aa3d2b74490ba0979f0af2b25672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:54.431686 32713 tablet_replica.cc:330] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: stopping tablet replica
I20260809 00:45:54.432258 32713 raft_consensus.cc:2229] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:54.432773 32713 raft_consensus.cc:2258] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:54.432868 32477 tablet_service.cc:1467] Processing CreateTablet for tablet 17bc51cb7cdf47ff8e3932bb833a1938 (DEFAULT_TABLE table=test-table [id=c2f6aa3d2b74490ba0979f0af2b25672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:54.433347 32477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17bc51cb7cdf47ff8e3932bb833a1938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:54.435995 32713 ts_tablet_manager.cc:1905] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:54.433815 32244 tablet_service.cc:1467] Processing CreateTablet for tablet 17bc51cb7cdf47ff8e3932bb833a1938 (DEFAULT_TABLE table=test-table [id=c2f6aa3d2b74490ba0979f0af2b25672]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:54.436836 32244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17bc51cb7cdf47ff8e3932bb833a1938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:54.443559 32717 tablet_bootstrap.cc:492] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Bootstrap starting.
I20260809 00:45:54.445420 32717 tablet_bootstrap.cc:654] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:54.451066 32717 tablet_bootstrap.cc:492] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: No bootstrap required, opened a new log
I20260809 00:45:54.451220 32717 ts_tablet_manager.cc:1397] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 00:45:54.452003 32717 raft_consensus.cc:348] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.452260 32717 raft_consensus.cc:374] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:54.452350 32717 raft_consensus.cc:729] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Initialized, Role: FOLLOWER
I20260809 00:45:54.452669 32717 consensus_queue.cc:260] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.453363 32717 ts_tablet_manager.cc:1428] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 00:45:54.488627 32025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17bc51cb7cdf47ff8e3932bb833a1938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:54.502105 32626 raft_consensus.cc:482] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:54.502727 32626 raft_consensus.cc:504] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.504846 32626 leader_election.cc:288] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325), 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285)
I20260809 00:45:54.517184 32719 tablet_bootstrap.cc:492] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Bootstrap starting.
I20260809 00:45:54.517911 32720 tablet_bootstrap.cc:492] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Bootstrap starting.
I20260809 00:45:54.521870 32719 tablet_bootstrap.cc:654] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:54.524981 32720 tablet_bootstrap.cc:654] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:54.530756 32719 tablet_bootstrap.cc:492] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: No bootstrap required, opened a new log
I20260809 00:45:54.530979 32719 ts_tablet_manager.cc:1397] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.009s
I20260809 00:45:54.531876 32719 raft_consensus.cc:348] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.532218 32719 raft_consensus.cc:374] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:54.532368 32719 raft_consensus.cc:729] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a02544eb003401d995a18ab9684048a, State: Initialized, Role: FOLLOWER
I20260809 00:45:54.532718 32719 consensus_queue.cc:260] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.533912 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.505848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:37257 (local address 127.28.92.129:43325)
0809 00:45:54.506052 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.506059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.519933 (+ 13874us) server_negotiation.cc:407] Connection header received
0809 00:45:54.521987 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.521994 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.522080 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.522161 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:54.523255 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.524413 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.531203 (+ 6790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.532552 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.532712 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.532799 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.533408 (+ 609us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.533572 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:45:54.534624 32719 ts_tablet_manager.cc:1428] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 00:45:54.535974 32723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.505486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43325 (local address 127.28.92.131:37257)
0809 00:45:54.519802 (+ 14316us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.519826 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.521765 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.522389 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.522394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.522425 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:54.522641 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.522655 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.524650 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.524655 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.530983 (+ 6328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.530997 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.532981 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.532987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.533200 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.533233 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.535505 (+ 2272us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.535646 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14145,"thread_start_us":14481,"threads_started":1}
I20260809 00:45:54.536048 32720 tablet_bootstrap.cc:492] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: No bootstrap required, opened a new log
I20260809 00:45:54.536195 32720 ts_tablet_manager.cc:1397] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.004s
I20260809 00:45:54.537051 32720 raft_consensus.cc:348] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.537308 32720 raft_consensus.cc:374] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:54.537403 32720 raft_consensus.cc:729] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e594b237a040679b062f0e1d718306, State: Initialized, Role: FOLLOWER
I20260809 00:45:54.537669 32720 consensus_queue.cc:260] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.538265 32720 ts_tablet_manager.cc:1428] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 00:45:54.538894 32067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bc51cb7cdf47ff8e3932bb833a1938" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e594b237a040679b062f0e1d718306" is_pre_election: true
I20260809 00:45:54.539139 32067 raft_consensus.cc:2454] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 0.
I20260809 00:45:54.539749 32398 leader_election.cc:302] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb74ecd0c2224858bbd5eacc3d900ab8, f5e594b237a040679b062f0e1d718306; no voters:
I20260809 00:45:54.540194 32626 raft_consensus.cc:2781] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:54.540321 32626 raft_consensus.cc:482] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:54.540412 32626 raft_consensus.cc:3037] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:54.542740 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.520636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:44685 (local address 127.28.92.130:34285)
0809 00:45:54.520830 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.520842 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.530236 (+ 9394us) server_negotiation.cc:407] Connection header received
0809 00:45:54.530506 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.530512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.530588 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.530646 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:45:54.531440 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.532535 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.540165 (+ 7630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.541406 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.541575 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.541678 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.542292 (+ 614us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.542436 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:45:54.543350 32724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.521448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34285 (local address 127.28.92.131:44685)
0809 00:45:54.530124 (+ 8676us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.530144 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.530332 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.530841 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.530846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.530877 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:45:54.531265 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.531279 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.532724 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.532729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.534592 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.534606 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.541879 (+ 7273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.541885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.542074 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.542110 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.542897 (+ 787us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.543040 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8545,"thread_start_us":8351,"threads_started":1}
I20260809 00:45:54.543915 32283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bc51cb7cdf47ff8e3932bb833a1938" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a" is_pre_election: true
I20260809 00:45:54.544144 32283 raft_consensus.cc:2454] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 0.
I20260809 00:45:54.586552 32713 ts_tablet_manager.cc:1918] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:54.586772 32713 log.cc:1196] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/e75e0d0ec328477bb60d06690d3a79d5
I20260809 00:45:54.587296 32713 ts_tablet_manager.cc:1939] T e75e0d0ec328477bb60d06690d3a79d5 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting consensus metadata
I20260809 00:45:54.587972 32715 ts_tablet_manager.cc:1918] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:54.588171 32715 log.cc:1196] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/e75e0d0ec328477bb60d06690d3a79d5
I20260809 00:45:54.588676 32715 ts_tablet_manager.cc:1939] T e75e0d0ec328477bb60d06690d3a79d5 P 3a02544eb003401d995a18ab9684048a: Deleting consensus metadata
I20260809 00:45:54.589260 32712 ts_tablet_manager.cc:1918] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:54.589434 32712 log.cc:1196] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/e75e0d0ec328477bb60d06690d3a79d5
I20260809 00:45:54.589982 32712 ts_tablet_manager.cc:1939] T e75e0d0ec328477bb60d06690d3a79d5 P f5e594b237a040679b062f0e1d718306: Deleting consensus metadata
I20260809 00:45:54.590613 32626 raft_consensus.cc:504] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.591542 32626 leader_election.cc:288] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 election: Requested vote from peers f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325), 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285)
I20260809 00:45:54.592471 32067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bc51cb7cdf47ff8e3932bb833a1938" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e594b237a040679b062f0e1d718306"
I20260809 00:45:54.592747 32067 raft_consensus.cc:3037] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:54.593047 31785 catalog_manager.cc:4841] TS cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141): tablet e75e0d0ec328477bb60d06690d3a79d5 (table test-table [id=6e32e73f4fa74f72a3d190405d8ba431]) successfully deleted
I20260809 00:45:54.593825 32283 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17bc51cb7cdf47ff8e3932bb833a1938" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a"
I20260809 00:45:54.594094 32283 raft_consensus.cc:3037] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:54.634941 31785 catalog_manager.cc:4841] TS 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285): tablet e75e0d0ec328477bb60d06690d3a79d5 (table test-table [id=6e32e73f4fa74f72a3d190405d8ba431]) successfully deleted
I20260809 00:45:54.636745 31785 catalog_manager.cc:4841] TS f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325): tablet e75e0d0ec328477bb60d06690d3a79d5 (table test-table [id=6e32e73f4fa74f72a3d190405d8ba431]) successfully deleted
I20260809 00:45:54.687461 32067 raft_consensus.cc:2454] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 1.
I20260809 00:45:54.688042 32398 leader_election.cc:302] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb74ecd0c2224858bbd5eacc3d900ab8, f5e594b237a040679b062f0e1d718306; no voters:
I20260809 00:45:54.688398 32626 raft_consensus.cc:2781] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:54.692214 32283 raft_consensus.cc:2454] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 1.
I20260809 00:45:54.693037 32626 raft_consensus.cc:686] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 LEADER]: Becoming Leader. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Running, Role: LEADER
I20260809 00:45:54.693517 32626 consensus_queue.cc:237] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:54.697299 31803 catalog_manager.cc:5495] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } health_report { overall_health: HEALTHY } } }
I20260809 00:45:54.762506 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.756550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54982 (local address 127.28.92.131:45141)
0809 00:45:54.757149 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.757154 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.757171 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:45:54.757250 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.757253 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.757324 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.757481 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.757960 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.758842 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.760167 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.760593 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.760701 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.761150 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.761824 (+ 674us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.761966 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.762057 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.762136 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":350,"threads_started":1}
I20260809 00:45:54.785109 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.777938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34285 (local address 127.28.92.131:50305)
0809 00:45:54.778855 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.778872 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.779063 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.779394 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.779398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.779410 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:54.780052 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.780064 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.781256 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.781261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.782764 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.782779 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.783717 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.783725 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.783915 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.783976 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.784384 (+ 408us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.784396 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.784482 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.784618 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":436,"threads_started":1}
I20260809 00:45:54.785113 32609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.777466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:50305 (local address 127.28.92.130:34285)
0809 00:45:54.777697 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.777703 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.778980 (+ 1277us) server_negotiation.cc:407] Connection header received
0809 00:45:54.779204 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.779208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.779278 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.779367 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.780224 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.781109 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.782926 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.783506 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.783631 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.784152 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.784273 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.784377 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.784507 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.784591 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 00:45:54.797194 32067 raft_consensus.cc:1261] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Refusing update from remote peer cb74ecd0c2224858bbd5eacc3d900ab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:54.797686 32283 raft_consensus.cc:1261] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Refusing update from remote peer cb74ecd0c2224858bbd5eacc3d900ab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:54.798363 32729 consensus_queue.cc:1035] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:54.799847 32729 consensus_queue.cc:1035] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:54.846092 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.835838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45141 (local address 127.28.92.130:49029)
0809 00:45:54.836235 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0809 00:45:54.836257 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:45:54.836366 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:45:54.837545 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:45:54.837554 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:45:54.837569 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:45:54.837969 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.837982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.839735 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.839741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.843188 (+ 3447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:45:54.843207 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.844633 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.844641 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:45:54.844882 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.844937 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.845420 (+ 483us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.845433 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 00:45:54.845511 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 00:45:54.845693 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247}
I20260809 00:45:54.846747 32732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:54.836724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:49029 (local address 127.28.92.131:45141)
0809 00:45:54.836893 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:54.836906 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:54.836923 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:45:54.837003 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:54.837008 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:54.837101 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:54.837177 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:54.838133 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.839576 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.843393 (+ 3817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:54.844355 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:54.844487 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:54.845128 (+ 641us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:54.845270 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:54.845362 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:54.846382 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0809 00:45:54.846468 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 00:45:54.850721 32687 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 00:45:56.479941 31803 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:56.480224 31803 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:56.485634 31803 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Sending DeleteTablet for 3 replicas of tablet 17bc51cb7cdf47ff8e3932bb833a1938
I20260809 00:45:56.486652 32025 tablet_service.cc:1514] Processing DeleteTablet for tablet 17bc51cb7cdf47ff8e3932bb833a1938 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:56 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38612
I20260809 00:45:56.486703 32244 tablet_service.cc:1514] Processing DeleteTablet for tablet 17bc51cb7cdf47ff8e3932bb833a1938 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:56 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60118
I20260809 00:45:56.486776 32477 tablet_service.cc:1514] Processing DeleteTablet for tablet 17bc51cb7cdf47ff8e3932bb833a1938 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:56 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:41560
I20260809 00:45:56.498818 329 tablet_replica.cc:330] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: stopping tablet replica
I20260809 00:45:56.499290 329 raft_consensus.cc:2229] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:45:56.500226 329 raft_consensus.cc:2258] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:56.501439 331 tablet_replica.cc:330] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: stopping tablet replica
I20260809 00:45:56.501824 327 tablet_replica.cc:330] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: stopping tablet replica
I20260809 00:45:56.501780 331 raft_consensus.cc:2229] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:56.502116 327 raft_consensus.cc:2229] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:56.502219 331 raft_consensus.cc:2258] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:56.502488 329 ts_tablet_manager.cc:1905] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:56.502522 327 raft_consensus.cc:2258] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:56.503399 331 ts_tablet_manager.cc:1905] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:56.503523 327 ts_tablet_manager.cc:1905] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:56.511749 327 ts_tablet_manager.cc:1918] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 00:45:56.511938 327 log.cc:1196] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/17bc51cb7cdf47ff8e3932bb833a1938
I20260809 00:45:56.511906 329 ts_tablet_manager.cc:1918] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 00:45:56.512107 329 log.cc:1196] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/17bc51cb7cdf47ff8e3932bb833a1938
I20260809 00:45:56.512122 331 ts_tablet_manager.cc:1918] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 00:45:56.512445 331 log.cc:1196] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/17bc51cb7cdf47ff8e3932bb833a1938
I20260809 00:45:56.512480 327 ts_tablet_manager.cc:1939] T 17bc51cb7cdf47ff8e3932bb833a1938 P f5e594b237a040679b062f0e1d718306: Deleting consensus metadata
I20260809 00:45:56.512703 329 ts_tablet_manager.cc:1939] T 17bc51cb7cdf47ff8e3932bb833a1938 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting consensus metadata
I20260809 00:45:56.513384 331 ts_tablet_manager.cc:1939] T 17bc51cb7cdf47ff8e3932bb833a1938 P 3a02544eb003401d995a18ab9684048a: Deleting consensus metadata
I20260809 00:45:56.513787 31785 catalog_manager.cc:4841] TS f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325): tablet 17bc51cb7cdf47ff8e3932bb833a1938 (table test-table [id=c2f6aa3d2b74490ba0979f0af2b25672]) successfully deleted
I20260809 00:45:56.514498 31785 catalog_manager.cc:4841] TS cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141): tablet 17bc51cb7cdf47ff8e3932bb833a1938 (table test-table [id=c2f6aa3d2b74490ba0979f0af2b25672]) successfully deleted
I20260809 00:45:56.515165 31785 catalog_manager.cc:4841] TS 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285): tablet 17bc51cb7cdf47ff8e3932bb833a1938 (table test-table [id=c2f6aa3d2b74490ba0979f0af2b25672]) successfully deleted
Aug 09 00:45:56 dist-test-slave-t7g5 krb5kdc[31735](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 00:45:56 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:45:56.552227 343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:56.537242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59754 (local address 127.28.92.190:42199)
0809 00:45:56.537837 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:56.537841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:56.537874 (+ 33us) server_negotiation.cc:407] Connection header received
0809 00:45:56.538054 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:56.538058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:56.538133 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:56.538229 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:56.539569 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:56.540326 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:56.541716 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:56.542145 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:56.542265 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:56.546302 (+ 4037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:56.546307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:56.546310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:56.546345 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:56.549316 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:56.550117 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:56.550121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:56.550123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:56.550375 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:56.550665 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:56.550668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:56.550670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:56.551055 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:56.551292 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:56.551544 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 00:45:56.551746 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":294,"threads_started":1}
I20260809 00:45:56.555686 31803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59754:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:45:56.556267 31803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:56.562529 32025 tablet_service.cc:1467] Processing CreateTablet for tablet 15812fcf7efc44239d430688467fbc86 (DEFAULT_TABLE table=test-table [id=d867cce53a954b6b9b19e20924d73689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:56.562593 32244 tablet_service.cc:1467] Processing CreateTablet for tablet 15812fcf7efc44239d430688467fbc86 (DEFAULT_TABLE table=test-table [id=d867cce53a954b6b9b19e20924d73689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:56.563015 32244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15812fcf7efc44239d430688467fbc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:56.562928 32477 tablet_service.cc:1467] Processing CreateTablet for tablet 15812fcf7efc44239d430688467fbc86 (DEFAULT_TABLE table=test-table [id=d867cce53a954b6b9b19e20924d73689]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:56.563077 32025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15812fcf7efc44239d430688467fbc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:56.563400 32477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15812fcf7efc44239d430688467fbc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:56.570485 344 tablet_bootstrap.cc:492] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Bootstrap starting.
I20260809 00:45:56.572183 347 tablet_bootstrap.cc:492] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Bootstrap starting.
I20260809 00:45:56.574088 344 tablet_bootstrap.cc:654] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:56.575651 347 tablet_bootstrap.cc:654] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:56.577842 345 tablet_bootstrap.cc:492] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Bootstrap starting.
I20260809 00:45:56.580310 344 tablet_bootstrap.cc:492] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: No bootstrap required, opened a new log
I20260809 00:45:56.580437 345 tablet_bootstrap.cc:654] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:56.580518 344 ts_tablet_manager.cc:1397] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.005s
I20260809 00:45:56.581287 347 tablet_bootstrap.cc:492] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: No bootstrap required, opened a new log
I20260809 00:45:56.581478 347 ts_tablet_manager.cc:1397] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260809 00:45:56.581883 344 raft_consensus.cc:348] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.582263 344 raft_consensus.cc:374] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:56.582455 344 raft_consensus.cc:729] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Initialized, Role: FOLLOWER
I20260809 00:45:56.582808 344 consensus_queue.cc:260] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.582902 347 raft_consensus.cc:348] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.583235 347 raft_consensus.cc:374] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:56.583451 347 raft_consensus.cc:729] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a02544eb003401d995a18ab9684048a, State: Initialized, Role: FOLLOWER
I20260809 00:45:56.583501 344 ts_tablet_manager.cc:1428] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260809 00:45:56.583841 347 consensus_queue.cc:260] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.584594 347 ts_tablet_manager.cc:1428] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260809 00:45:56.587100 345 tablet_bootstrap.cc:492] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: No bootstrap required, opened a new log
I20260809 00:45:56.587358 345 ts_tablet_manager.cc:1397] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260809 00:45:56.588711 345 raft_consensus.cc:348] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.589056 345 raft_consensus.cc:374] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:56.589198 345 raft_consensus.cc:729] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e594b237a040679b062f0e1d718306, State: Initialized, Role: FOLLOWER
I20260809 00:45:56.589509 345 consensus_queue.cc:260] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.590426 345 ts_tablet_manager.cc:1428] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260809 00:45:56.763307 353 raft_consensus.cc:482] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:56.763649 353 raft_consensus.cc:504] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.764614 353 leader_election.cc:288] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285), cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:56.765357 32282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15812fcf7efc44239d430688467fbc86" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a" is_pre_election: true
I20260809 00:45:56.765378 32512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15812fcf7efc44239d430688467fbc86" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" is_pre_election: true
I20260809 00:45:56.765755 32512 raft_consensus.cc:2454] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 0.
I20260809 00:45:56.765805 32282 raft_consensus.cc:2454] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 0.
I20260809 00:45:56.766435 31953 leader_election.cc:302] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb74ecd0c2224858bbd5eacc3d900ab8, f5e594b237a040679b062f0e1d718306; no voters:
I20260809 00:45:56.766745 353 raft_consensus.cc:2781] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:56.766911 353 raft_consensus.cc:482] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:56.767025 353 raft_consensus.cc:3037] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:56.769850 353 raft_consensus.cc:504] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.770562 353 leader_election.cc:288] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 election: Requested vote from peers 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285), cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141)
I20260809 00:45:56.771080 32282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15812fcf7efc44239d430688467fbc86" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a"
I20260809 00:45:56.771134 32512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15812fcf7efc44239d430688467fbc86" candidate_uuid: "f5e594b237a040679b062f0e1d718306" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8"
I20260809 00:45:56.771370 32282 raft_consensus.cc:3037] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:56.771456 32512 raft_consensus.cc:3037] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:56.774268 32282 raft_consensus.cc:2454] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 1.
I20260809 00:45:56.774376 32512 raft_consensus.cc:2454] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5e594b237a040679b062f0e1d718306 in term 1.
I20260809 00:45:56.774757 31953 leader_election.cc:302] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, f5e594b237a040679b062f0e1d718306; no voters:
I20260809 00:45:56.775099 353 raft_consensus.cc:2781] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:56.775844 353 raft_consensus.cc:686] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 1 LEADER]: Becoming Leader. State: Replica: f5e594b237a040679b062f0e1d718306, State: Running, Role: LEADER
I20260809 00:45:56.776158 353 consensus_queue.cc:237] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.779239 31802 catalog_manager.cc:5495] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5e594b237a040679b062f0e1d718306 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "f5e594b237a040679b062f0e1d718306" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } health_report { overall_health: UNKNOWN } } }
I20260809 00:45:56.832118 358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:56.826282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.28.92.129:43325)
0809 00:45:56.827466 (+ 1184us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:56.827470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:56.827490 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:45:56.827544 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:56.827548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:56.827609 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:56.827690 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:56.828107 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:56.828861 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:56.830363 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:56.830821 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:56.830925 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:56.831331 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:56.831443 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:56.831507 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:56.831609 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 00:45:56.831707 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1063,"thread_start_us":818,"threads_started":1}
I20260809 00:45:56.842612 32512 raft_consensus.cc:1261] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Refusing update from remote peer f5e594b237a040679b062f0e1d718306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:56.842629 32282 raft_consensus.cc:1261] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Refusing update from remote peer f5e594b237a040679b062f0e1d718306: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:56.843212 354 consensus_queue.cc:1035] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:56.843662 353 consensus_queue.cc:1035] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:56.896908 31803 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:56.897200 31803 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:56.900370 31803 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Sending DeleteTablet for 3 replicas of tablet 15812fcf7efc44239d430688467fbc86
I20260809 00:45:56.901204 32025 tablet_service.cc:1514] Processing DeleteTablet for tablet 15812fcf7efc44239d430688467fbc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:56 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38612
I20260809 00:45:56.901506 327 tablet_replica.cc:330] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: stopping tablet replica
I20260809 00:45:56.901633 32477 tablet_service.cc:1514] Processing DeleteTablet for tablet 15812fcf7efc44239d430688467fbc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:56 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:41560
I20260809 00:45:56.901758 32244 tablet_service.cc:1514] Processing DeleteTablet for tablet 15812fcf7efc44239d430688467fbc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:56 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60118
I20260809 00:45:56.901856 327 raft_consensus.cc:2229] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:45:56.902034 329 tablet_replica.cc:330] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: stopping tablet replica
I20260809 00:45:56.902190 327 raft_consensus.cc:2258] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:56.902256 331 tablet_replica.cc:330] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: stopping tablet replica
I20260809 00:45:56.902405 329 raft_consensus.cc:2229] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:56.902587 331 raft_consensus.cc:2229] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:56.902697 329 raft_consensus.cc:2258] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:56.902868 331 raft_consensus.cc:2258] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:56.903481 327 ts_tablet_manager.cc:1905] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:56.903877 329 ts_tablet_manager.cc:1905] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:56.903908 331 ts_tablet_manager.cc:1905] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:56.909619 331 ts_tablet_manager.cc:1918] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:56.909968 331 log.cc:1196] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/15812fcf7efc44239d430688467fbc86
I20260809 00:45:56.910269 327 ts_tablet_manager.cc:1918] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:56.910581 327 log.cc:1196] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/15812fcf7efc44239d430688467fbc86
I20260809 00:45:56.910573 31803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59754:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 00:45:56.911150 327 ts_tablet_manager.cc:1939] T 15812fcf7efc44239d430688467fbc86 P f5e594b237a040679b062f0e1d718306: Deleting consensus metadata
W20260809 00:45:56.911417 31803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:45:56.911589 329 ts_tablet_manager.cc:1918] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:45:56.911877 329 log.cc:1196] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/15812fcf7efc44239d430688467fbc86
I20260809 00:45:56.912376 31785 catalog_manager.cc:4841] TS f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325): tablet 15812fcf7efc44239d430688467fbc86 (table test-table [id=d867cce53a954b6b9b19e20924d73689]) successfully deleted
I20260809 00:45:56.912523 329 ts_tablet_manager.cc:1939] T 15812fcf7efc44239d430688467fbc86 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting consensus metadata
I20260809 00:45:56.912555 331 ts_tablet_manager.cc:1939] T 15812fcf7efc44239d430688467fbc86 P 3a02544eb003401d995a18ab9684048a: Deleting consensus metadata
I20260809 00:45:56.913511 31785 catalog_manager.cc:4841] TS 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285): tablet 15812fcf7efc44239d430688467fbc86 (table test-table [id=d867cce53a954b6b9b19e20924d73689]) successfully deleted
I20260809 00:45:56.913858 31785 catalog_manager.cc:4841] TS cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141): tablet 15812fcf7efc44239d430688467fbc86 (table test-table [id=d867cce53a954b6b9b19e20924d73689]) successfully deleted
I20260809 00:45:56.918426 32025 tablet_service.cc:1467] Processing CreateTablet for tablet 49f6890ceaa0422e8619d80173cf2461 (DEFAULT_TABLE table=test-table [id=abff90a35aff40fe8cf90ae884bb606b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:56.918727 32244 tablet_service.cc:1467] Processing CreateTablet for tablet 49f6890ceaa0422e8619d80173cf2461 (DEFAULT_TABLE table=test-table [id=abff90a35aff40fe8cf90ae884bb606b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:56.918983 32025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49f6890ceaa0422e8619d80173cf2461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:56.919205 32477 tablet_service.cc:1467] Processing CreateTablet for tablet 49f6890ceaa0422e8619d80173cf2461 (DEFAULT_TABLE table=test-table [id=abff90a35aff40fe8cf90ae884bb606b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:45:56.919343 32244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49f6890ceaa0422e8619d80173cf2461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:56.919739 32477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49f6890ceaa0422e8619d80173cf2461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:45:56.925310 345 tablet_bootstrap.cc:492] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Bootstrap starting.
I20260809 00:45:56.927277 344 tablet_bootstrap.cc:492] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Bootstrap starting.
I20260809 00:45:56.927829 347 tablet_bootstrap.cc:492] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Bootstrap starting.
I20260809 00:45:56.928063 345 tablet_bootstrap.cc:654] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:56.929781 344 tablet_bootstrap.cc:654] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:56.930878 347 tablet_bootstrap.cc:654] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Neither blocks nor log segments found. Creating new log.
I20260809 00:45:56.932116 345 tablet_bootstrap.cc:492] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: No bootstrap required, opened a new log
I20260809 00:45:56.932430 345 ts_tablet_manager.cc:1397] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 00:45:56.933612 345 raft_consensus.cc:348] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.934064 345 raft_consensus.cc:374] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:56.934232 345 raft_consensus.cc:729] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e594b237a040679b062f0e1d718306, State: Initialized, Role: FOLLOWER
I20260809 00:45:56.934705 347 tablet_bootstrap.cc:492] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: No bootstrap required, opened a new log
I20260809 00:45:56.934640 345 consensus_queue.cc:260] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.935041 347 ts_tablet_manager.cc:1397] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260809 00:45:56.935899 345 ts_tablet_manager.cc:1428] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260809 00:45:56.936211 347 raft_consensus.cc:348] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.936545 347 raft_consensus.cc:374] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:56.936640 347 raft_consensus.cc:729] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a02544eb003401d995a18ab9684048a, State: Initialized, Role: FOLLOWER
I20260809 00:45:56.936846 347 consensus_queue.cc:260] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.937696 347 ts_tablet_manager.cc:1428] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260809 00:45:56.938377 344 tablet_bootstrap.cc:492] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: No bootstrap required, opened a new log
I20260809 00:45:56.938887 344 ts_tablet_manager.cc:1397] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260809 00:45:56.940093 344 raft_consensus.cc:348] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.940361 344 raft_consensus.cc:374] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:45:56.940554 344 raft_consensus.cc:729] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Initialized, Role: FOLLOWER
I20260809 00:45:56.940893 344 consensus_queue.cc:260] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.942090 344 ts_tablet_manager.cc:1428] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 00:45:56.986304 312 raft_consensus.cc:482] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:45:56.986532 312 raft_consensus.cc:504] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.987282 312 leader_election.cc:288] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325), 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285)
I20260809 00:45:56.987829 32067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49f6890ceaa0422e8619d80173cf2461" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e594b237a040679b062f0e1d718306" is_pre_election: true
I20260809 00:45:56.987973 32282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49f6890ceaa0422e8619d80173cf2461" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a" is_pre_election: true
I20260809 00:45:56.988216 32282 raft_consensus.cc:2454] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 0.
I20260809 00:45:56.988198 32067 raft_consensus.cc:2454] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 0.
I20260809 00:45:56.988834 32398 leader_election.cc:302] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, cb74ecd0c2224858bbd5eacc3d900ab8; no voters:
I20260809 00:45:56.989184 312 raft_consensus.cc:2781] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:45:56.989403 312 raft_consensus.cc:482] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:45:56.989560 312 raft_consensus.cc:3037] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:56.992576 312 raft_consensus.cc:504] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:56.993309 312 leader_election.cc:288] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 election: Requested vote from peers f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325), 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285)
I20260809 00:45:56.993968 32282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49f6890ceaa0422e8619d80173cf2461" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a02544eb003401d995a18ab9684048a"
I20260809 00:45:56.993973 32067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49f6890ceaa0422e8619d80173cf2461" candidate_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e594b237a040679b062f0e1d718306"
I20260809 00:45:56.994242 32067 raft_consensus.cc:3037] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:56.994285 32282 raft_consensus.cc:3037] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:45:56.997886 32282 raft_consensus.cc:2454] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 1.
I20260809 00:45:56.997982 32067 raft_consensus.cc:2454] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb74ecd0c2224858bbd5eacc3d900ab8 in term 1.
I20260809 00:45:56.998404 32398 leader_election.cc:302] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a02544eb003401d995a18ab9684048a, cb74ecd0c2224858bbd5eacc3d900ab8; no voters:
I20260809 00:45:56.998829 312 raft_consensus.cc:2781] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:45:56.999524 312 raft_consensus.cc:686] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 LEADER]: Becoming Leader. State: Replica: cb74ecd0c2224858bbd5eacc3d900ab8, State: Running, Role: LEADER
I20260809 00:45:56.999835 312 consensus_queue.cc:237] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } }
I20260809 00:45:57.002846 31801 catalog_manager.cc:5495] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb74ecd0c2224858bbd5eacc3d900ab8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45141 } health_report { overall_health: HEALTHY } } }
I20260809 00:45:57.027179 369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:57.019719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54994 (local address 127.28.92.131:45141)
0809 00:45:57.020564 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:57.020569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:57.020621 (+ 52us) server_negotiation.cc:407] Connection header received
0809 00:45:57.020677 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:57.020680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:57.020740 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:57.020824 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:45:57.021473 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:57.022969 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:57.024683 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:57.025285 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:57.025411 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:57.026135 (+ 724us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:45:57.026253 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:45:57.026331 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:57.026478 (+ 147us) server_negotiation.cc:299] Negotiation successful
0809 00:45:57.026555 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":592,"threads_started":1}
I20260809 00:45:57.037914 32067 raft_consensus.cc:1261] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Refusing update from remote peer cb74ecd0c2224858bbd5eacc3d900ab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:57.037932 32282 raft_consensus.cc:1261] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Refusing update from remote peer cb74ecd0c2224858bbd5eacc3d900ab8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:45:57.038548 367 consensus_queue.cc:1035] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a02544eb003401d995a18ab9684048a" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:57.039156 312 consensus_queue.cc:1035] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e594b237a040679b062f0e1d718306" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:45:57.043848 32758 mvcc.cc:205] Tried to move back new op lower bound from 7316424118419488768 to 7316424118273650688. Current Snapshot: MvccSnapshot[applied={T|T < 7316424118419488768}]
W20260809 00:45:57.061933 32758 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 00:45:58.654446 31801 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:58.654903 31801 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59754:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:45:58.660997 31801 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fd9782e7ce64d65838845b123664993: Sending DeleteTablet for 3 replicas of tablet 49f6890ceaa0422e8619d80173cf2461
I20260809 00:45:58.662153 32477 tablet_service.cc:1514] Processing DeleteTablet for tablet 49f6890ceaa0422e8619d80173cf2461 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:58 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:41560
I20260809 00:45:58.662171 32025 tablet_service.cc:1514] Processing DeleteTablet for tablet 49f6890ceaa0422e8619d80173cf2461 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:58 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38612
I20260809 00:45:58.662137 32244 tablet_service.cc:1514] Processing DeleteTablet for tablet 49f6890ceaa0422e8619d80173cf2461 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:45:58 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60118
I20260809 00:45:58.663349 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31918
I20260809 00:45:58.675737 411 tablet_replica.cc:330] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: stopping tablet replica
I20260809 00:45:58.676071 411 raft_consensus.cc:2229] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:58.676432 411 raft_consensus.cc:2258] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:58.680845 415 tablet_replica.cc:330] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: stopping tablet replica
I20260809 00:45:58.680994 412 tablet_replica.cc:330] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: stopping tablet replica
I20260809 00:45:58.681183 415 raft_consensus.cc:2229] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:45:58.681212 412 raft_consensus.cc:2229] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:45:58.681466 412 raft_consensus.cc:2258] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:58.681902 415 raft_consensus.cc:2258] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:45:58.682549 411 ts_tablet_manager.cc:1905] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:58.682551 412 ts_tablet_manager.cc:1905] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:58.683126 415 ts_tablet_manager.cc:1905] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:45:58.690828 412 ts_tablet_manager.cc:1918] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 00:45:58.691030 412 log.cc:1196] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/49f6890ceaa0422e8619d80173cf2461
Aug 09 00:45:58 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:45:58.691700 412 ts_tablet_manager.cc:1939] T 49f6890ceaa0422e8619d80173cf2461 P 3a02544eb003401d995a18ab9684048a: Deleting consensus metadata
I20260809 00:45:58.691959 415 ts_tablet_manager.cc:1918] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 00:45:58.692206 415 log.cc:1196] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/49f6890ceaa0422e8619d80173cf2461
I20260809 00:45:58.692848 415 ts_tablet_manager.cc:1939] T 49f6890ceaa0422e8619d80173cf2461 P cb74ecd0c2224858bbd5eacc3d900ab8: Deleting consensus metadata
I20260809 00:45:58.692906 31785 catalog_manager.cc:4841] TS 3a02544eb003401d995a18ab9684048a (127.28.92.130:34285): tablet 49f6890ceaa0422e8619d80173cf2461 (table test-table [id=abff90a35aff40fe8cf90ae884bb606b]) successfully deleted
I20260809 00:45:58.694049 31785 catalog_manager.cc:4841] TS cb74ecd0c2224858bbd5eacc3d900ab8 (127.28.92.131:45141): tablet 49f6890ceaa0422e8619d80173cf2461 (table test-table [id=abff90a35aff40fe8cf90ae884bb606b]) successfully deleted
I20260809 00:45:58.694212 411 ts_tablet_manager.cc:1918] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 00:45:58.694522 411 log.cc:1196] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/49f6890ceaa0422e8619d80173cf2461
I20260809 00:45:58.695420 411 ts_tablet_manager.cc:1939] T 49f6890ceaa0422e8619d80173cf2461 P f5e594b237a040679b062f0e1d718306: Deleting consensus metadata
I20260809 00:45:58.696529 31785 catalog_manager.cc:4841] TS f5e594b237a040679b062f0e1d718306 (127.28.92.129:43325): tablet 49f6890ceaa0422e8619d80173cf2461 (table test-table [id=abff90a35aff40fe8cf90ae884bb606b]) successfully deleted
I20260809 00:45:58.701342 420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:58.665181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.28.92.129:43325)
0809 00:45:58.671186 (+ 6005us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:58.671193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:58.677271 (+ 6078us) server_negotiation.cc:407] Connection header received
0809 00:45:58.677519 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:58.677524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:58.677629 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:58.677725 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:58.680899 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:58.682144 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:58.684421 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:58.685395 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:58.685492 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:58.692913 (+ 7421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:58.692933 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:58.692956 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:58.692996 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:58.698443 (+ 5447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:58.699123 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:58.699130 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:58.699132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:58.699273 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:58.699703 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:58.699708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:58.699710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:58.700152 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:58.700420 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:58.700641 (+ 221us) server_negotiation.cc:299] Negotiation successful
0809 00:45:58.700827 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5860,"thread_start_us":5712,"threads_started":1}
W20260809 00:45:58.702253 32130 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33502
W20260809 00:45:58.703100 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31918: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:45:58.703413 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31918
I20260809 00:45:58.734027 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32144
Aug 09 00:45:58 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:45:58.749984 421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:58.734752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33806 (local address 127.28.92.130:34285)
0809 00:45:58.735807 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:58.735811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:58.735828 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:45:58.735883 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:58.735886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:58.736008 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:58.736101 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:58.737302 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:58.738239 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:58.739429 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:58.739859 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:58.739948 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:58.744133 (+ 4185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:58.744148 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:58.744166 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:58.744201 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:58.747656 (+ 3455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:58.748278 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:58.748285 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:58.748287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:58.748426 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:58.748709 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:58.748712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:58.748714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:58.749044 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:58.749270 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:58.749494 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 00:45:58.749706 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":923,"thread_start_us":668,"threads_started":1}
W20260809 00:45:58.750648 32352 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33806
W20260809 00:45:58.751255 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32144: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:45:58.751401 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 32144
I20260809 00:45:58.776947 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32371
Aug 09 00:45:58 dist-test-slave-t7g5 krb5kdc[31735](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236356, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:45:58.791409 422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:45:58.777668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55002 (local address 127.28.92.131:45141)
0809 00:45:58.778160 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0809 00:45:58.778165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:45:58.778181 (+ 16us) server_negotiation.cc:407] Connection header received
0809 00:45:58.778237 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:45:58.778241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:45:58.778300 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:45:58.778389 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:45:58.779622 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:58.780367 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:58.781519 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:45:58.781962 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:45:58.782053 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:45:58.786385 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:45:58.786400 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:45:58.786418 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:45:58.786455 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:45:58.788961 (+ 2506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:58.789587 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:58.789594 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:58.789596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:58.789836 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:45:58.790143 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:45:58.790146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:45:58.790148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:45:58.790500 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:45:58.790723 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 00:45:58.790911 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 00:45:58.791086 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":245,"threads_started":1}
W20260809 00:45:58.792074 32575 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55002
W20260809 00:45:58.792686 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32371: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:45:58.792850 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 32371
I20260809 00:45:58.820333 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31753
I20260809 00:45:58.821504 31877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:45:58.935724 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31753
2026-08-09T00:45:58Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9131 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:45:59 dist-test-slave-t7g5 krb5kdc[429](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:45:59 dist-test-slave-t7g5 krb5kdc[429](info): set up 2 sockets
Aug 09 00:45:59 dist-test-slave-t7g5 krb5kdc[429](info): commencing operation
krb5kdc: starting...
W20260809 00:46:00.170583 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.002s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:00 dist-test-slave-t7g5 krb5kdc[429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:00.374085 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:39153
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:39153
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:00.695741 449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:00.696070 449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:00.696208 449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:00.703457 449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:00.703590 449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:00.703675 449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:00.703749 449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:00.703809 449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:00.713762 449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:39153
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:39153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:00.715121 449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:00.716456 449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:00.728084 455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:00.728035 456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:00.728008 460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:00.728907 449 server_base.cc:1034] running on GCE node
I20260809 00:46:00.729620 449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:00.730998 449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:00.732197 449 hybrid_clock.cc:648] HybridClock initialized: now 1786236360732155 us; error 33 us; skew 500 ppm
I20260809 00:46:00.732488 449 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:00 dist-test-slave-t7g5 krb5kdc[429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236360, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:00.735389 449 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:00.736779 449 webserver.cc:460] Webserver started at http://127.28.92.190:45201/ using document root <none> and password file <none>
I20260809 00:46:00.737416 449 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:00.737534 449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:00.737879 449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:00.740713 449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "1914440f797e4bd48fec6348d0b09244"
format_stamp: "Formatted at 2026-08-09 00:46:00 on dist-test-slave-t7g5"
server_key: "2c163670b452131a0eb0f700c0d23809"
server_key_iv: "7d592700a5a600a9bc58fcc326227ab3"
server_key_version: "encryptionkey@0"
I20260809 00:46:00.741453 449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "1914440f797e4bd48fec6348d0b09244"
format_stamp: "Formatted at 2026-08-09 00:46:00 on dist-test-slave-t7g5"
server_key: "2c163670b452131a0eb0f700c0d23809"
server_key_iv: "7d592700a5a600a9bc58fcc326227ab3"
server_key_version: "encryptionkey@0"
I20260809 00:46:00.746495 449 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:46:00.749954 471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:00.751217 449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:46:00.751384 449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "1914440f797e4bd48fec6348d0b09244"
format_stamp: "Formatted at 2026-08-09 00:46:00 on dist-test-slave-t7g5"
server_key: "2c163670b452131a0eb0f700c0d23809"
server_key_iv: "7d592700a5a600a9bc58fcc326227ab3"
server_key_version: "encryptionkey@0"
I20260809 00:46:00.751582 449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:00.775255 449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:00.779141 449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:00.779419 449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:00.796231 449 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:39153
I20260809 00:46:00.796234 546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:39153 every 8 connection(s)
I20260809 00:46:00.797730 449 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:00.799603 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 449
I20260809 00:46:00.799810 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:00.800397 29042 external_mini_cluster.cc:1428] Setting key 063c1c5a9e783930249add2aeaf81223
I20260809 00:46:00.802001 547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 00:46:00 dist-test-slave-t7g5 krb5kdc[429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:00.815542 547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244: Bootstrap starting.
I20260809 00:46:00.819617 547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:00.821128 547 log.cc:824] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:00.824173 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:00.802504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58732 (local address 127.28.92.190:39153)
0809 00:46:00.803333 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:00.803348 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:00.803402 (+ 54us) server_negotiation.cc:407] Connection header received
0809 00:46:00.805405 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:00.805435 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:00.806003 (+ 568us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:00.806463 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:00.807748 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:00.809804 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:00.811036 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:00.812049 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:00.812237 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:00.816012 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:00.816024 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:00.816044 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:00.816090 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:00.819818 (+ 3728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:00.820459 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:00.820467 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:00.820475 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:00.820679 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:00.820998 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:00.821003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:00.821006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:00.821747 (+ 741us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:00.822010 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:00.822451 (+ 441us) server_negotiation.cc:299] Negotiation successful
0809 00:46:00.822867 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":347,"threads_started":1}
I20260809 00:46:00.824612 547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244: No bootstrap required, opened a new log
I20260809 00:46:00.832227 547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1914440f797e4bd48fec6348d0b09244" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39153 } }
I20260809 00:46:00.832757 547 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:00.832882 547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1914440f797e4bd48fec6348d0b09244, State: Initialized, Role: FOLLOWER
I20260809 00:46:00.833505 547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1914440f797e4bd48fec6348d0b09244" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39153 } }
I20260809 00:46:00.833746 547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:00.833899 547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:00.834059 547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:00.836156 547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1914440f797e4bd48fec6348d0b09244" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39153 } }
I20260809 00:46:00.836642 547 leader_election.cc:302] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1914440f797e4bd48fec6348d0b09244; no voters:
I20260809 00:46:00.837206 547 leader_election.cc:288] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:00.837344 557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:00.838018 557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [term 1 LEADER]: Becoming Leader. State: Replica: 1914440f797e4bd48fec6348d0b09244, State: Running, Role: LEADER
I20260809 00:46:00.838502 557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1914440f797e4bd48fec6348d0b09244" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39153 } }
I20260809 00:46:00.839323 547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:00.841346 559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1914440f797e4bd48fec6348d0b09244. Latest consensus state: current_term: 1 leader_uuid: "1914440f797e4bd48fec6348d0b09244" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1914440f797e4bd48fec6348d0b09244" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39153 } } }
I20260809 00:46:00.841809 559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:00.844945 558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1914440f797e4bd48fec6348d0b09244" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1914440f797e4bd48fec6348d0b09244" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39153 } } }
I20260809 00:46:00.845290 558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:00.845621 572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:00.850067 572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:00.858251 572 catalog_manager.cc:1347] Generated new cluster ID: 865eda3489c94b6699b1cd071d6f71b0
I20260809 00:46:00.858378 572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:00.868124 572 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:00.870091 572 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:00.882860 572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1914440f797e4bd48fec6348d0b09244: Generated new TSK 0
I20260809 00:46:00.884079 572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:46:00.934614 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39153
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:01.262389 587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:01.262681 587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:01.262774 587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:01.269902 587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:01.270022 587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:01.270144 587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:01.279699 587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:01.280929 587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:01.282253 587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:01.294999 596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:01.295030 601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:01.295063 599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:01.296216 587 server_base.cc:1034] running on GCE node
I20260809 00:46:01.296813 587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:01.297756 587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:01.298971 587 hybrid_clock.cc:648] HybridClock initialized: now 1786236361298912 us; error 46 us; skew 500 ppm
I20260809 00:46:01.299283 587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:01 dist-test-slave-t7g5 krb5kdc[429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236361, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:01.302424 587 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:46:01.303797 587 webserver.cc:460] Webserver started at http://127.28.92.129:35979/ using document root <none> and password file <none>
I20260809 00:46:01.304479 587 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:01.304581 587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:01.304836 587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:01.307770 587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "f41f801292f746029c25984dc70460e1"
format_stamp: "Formatted at 2026-08-09 00:46:01 on dist-test-slave-t7g5"
server_key: "7c7d9fc07bda21ca674d983ac400593c"
server_key_iv: "0f13a7e4757b3c074f3ae86da8434d62"
server_key_version: "encryptionkey@0"
I20260809 00:46:01.308535 587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "f41f801292f746029c25984dc70460e1"
format_stamp: "Formatted at 2026-08-09 00:46:01 on dist-test-slave-t7g5"
server_key: "7c7d9fc07bda21ca674d983ac400593c"
server_key_iv: "0f13a7e4757b3c074f3ae86da8434d62"
server_key_version: "encryptionkey@0"
I20260809 00:46:01.313684 587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:46:01.317066 610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:01.318428 587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 00:46:01.318593 587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "f41f801292f746029c25984dc70460e1"
format_stamp: "Formatted at 2026-08-09 00:46:01 on dist-test-slave-t7g5"
server_key: "7c7d9fc07bda21ca674d983ac400593c"
server_key_iv: "0f13a7e4757b3c074f3ae86da8434d62"
server_key_version: "encryptionkey@0"
I20260809 00:46:01.318781 587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:01.331175 587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:01.335415 587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:01.335702 587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:01.336623 587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:01.338006 587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:01.338091 587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:01.338212 587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:01.338265 587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:01.367744 587 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40207
I20260809 00:46:01.367794 781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40207 every 8 connection(s)
I20260809 00:46:01.369011 587 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:01.373942 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 587
I20260809 00:46:01.374163 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:01.374938 29042 external_mini_cluster.cc:1428] Setting key 5657b5ea51f00be04d67b210ee2a7316
Aug 09 00:46:01 dist-test-slave-t7g5 krb5kdc[429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236361, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:01.389953 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:01.371486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:51571 (local address 127.28.92.190:39153)
0809 00:46:01.371882 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:01.371886 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:01.372761 (+ 875us) server_negotiation.cc:407] Connection header received
0809 00:46:01.375097 (+ 2336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:01.375103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:01.375175 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:01.375271 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:01.377042 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.377795 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.379964 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.380355 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.380446 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:01.384296 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:01.384304 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:01.384307 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:01.384340 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:01.386926 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:01.387642 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:01.387647 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:01.387649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:01.387774 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:01.388198 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:01.388204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:01.388206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:01.388488 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:01.388624 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:01.389315 (+ 691us) server_negotiation.cc:299] Negotiation successful
0809 00:46:01.389555 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":195,"threads_started":1}
I20260809 00:46:01.390964 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:01.371915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39153 (local address 127.28.92.129:51571)
0809 00:46:01.372599 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:01.372644 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:01.374774 (+ 2130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:01.375552 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:01.375565 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:01.376215 (+ 650us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:01.376866 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:01.376886 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.377955 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.377961 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:01.379839 (+ 1878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:01.379863 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.380570 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.380578 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:01.380842 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:01.381544 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:01.381570 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:01.384076 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:01.387061 (+ 2985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:01.387072 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:01.387090 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:01.387526 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:01.387894 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:01.387900 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:01.387904 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:01.388092 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:01.388615 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:01.388623 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:01.388970 (+ 347us) client_negotiation.cc:769] Sending connection context
0809 00:46:01.389214 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 00:46:01.389784 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":277,"threads_started":1}
I20260809 00:46:01.392562 784 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39153
I20260809 00:46:01.392925 784 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:01.393869 784 heartbeater.cc:511] Master 127.28.92.190:39153 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
I20260809 00:46:01.396278 503 ts_manager.cc:194] Registered new tserver with Master: f41f801292f746029c25984dc70460e1 (127.28.92.129:40207)
I20260809 00:46:01.397804 503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:51571
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:46:01.420987 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39153
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:01.747916 798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:01.748219 798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:01.748317 798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:01.755565 798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:01.755688 798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:01.755810 798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:01.765618 798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:01.767005 798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:01.768333 798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:01.781127 805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:01.781181 808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:01.781127 815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:01.782162 798 server_base.cc:1034] running on GCE node
I20260809 00:46:01.782734 798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:01.783605 798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:01.784801 798 hybrid_clock.cc:648] HybridClock initialized: now 1786236361784754 us; error 38 us; skew 500 ppm
I20260809 00:46:01.785120 798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:01 dist-test-slave-t7g5 krb5kdc[429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236361, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:01.788237 798 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:46:01.789777 798 webserver.cc:460] Webserver started at http://127.28.92.130:38087/ using document root <none> and password file <none>
I20260809 00:46:01.790493 798 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:01.790606 798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:01.790961 798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:01.794034 798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "aebd04bafa284caea2cec8b29ba7b4f5"
format_stamp: "Formatted at 2026-08-09 00:46:01 on dist-test-slave-t7g5"
server_key: "96397750c302be07884e189517a3eade"
server_key_iv: "75e715ff4c73168728479c87b35677b1"
server_key_version: "encryptionkey@0"
I20260809 00:46:01.794836 798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "aebd04bafa284caea2cec8b29ba7b4f5"
format_stamp: "Formatted at 2026-08-09 00:46:01 on dist-test-slave-t7g5"
server_key: "96397750c302be07884e189517a3eade"
server_key_iv: "75e715ff4c73168728479c87b35677b1"
server_key_version: "encryptionkey@0"
I20260809 00:46:01.801755 798 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260809 00:46:01.806095 827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:01.807636 798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:46:01.807818 798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "aebd04bafa284caea2cec8b29ba7b4f5"
format_stamp: "Formatted at 2026-08-09 00:46:01 on dist-test-slave-t7g5"
server_key: "96397750c302be07884e189517a3eade"
server_key_iv: "75e715ff4c73168728479c87b35677b1"
server_key_version: "encryptionkey@0"
I20260809 00:46:01.808060 798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:01.826388 798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:01.830696 798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:01.830953 798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:01.831879 798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:01.833137 798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:01.833210 798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:01.833308 798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:01.833359 798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:01.863176 798 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:39617
I20260809 00:46:01.863216 1012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:39617 every 8 connection(s)
I20260809 00:46:01.864442 798 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:01.872447 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 798
I20260809 00:46:01.872617 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:01.873023 29042 external_mini_cluster.cc:1428] Setting key bc135d7ae928942da26432bf3d89c0f4
Aug 09 00:46:01 dist-test-slave-t7g5 krb5kdc[429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236361, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:01.884895 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:01.866968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:35599 (local address 127.28.92.190:39153)
0809 00:46:01.867138 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:01.867143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:01.868429 (+ 1286us) server_negotiation.cc:407] Connection header received
0809 00:46:01.870358 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:01.870363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:01.870437 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:01.870536 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:01.872067 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.872852 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.874776 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.875321 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.875464 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:01.879235 (+ 3771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:01.879241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:01.879245 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:01.879278 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:01.881936 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:01.882612 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:01.882617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:01.882620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:01.882780 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:01.883265 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:01.883269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:01.883271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:01.883567 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:01.883682 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:01.884480 (+ 798us) server_negotiation.cc:299] Negotiation successful
0809 00:46:01.884653 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 00:46:01.886389 1015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:01.867427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39153 (local address 127.28.92.130:35599)
0809 00:46:01.868228 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:01.868278 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:01.870093 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:01.870814 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:01.870823 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:01.871326 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:01.871892 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:01.871911 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.873007 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.873011 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:01.874641 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:01.874656 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:01.875587 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:01.875596 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:01.875827 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:01.876464 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:01.876487 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:01.878998 (+ 2511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:01.882060 (+ 3062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:01.882067 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:01.882079 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:01.882487 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:01.882889 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:01.882893 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:01.882896 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:01.883141 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:01.883685 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:01.883692 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:01.884113 (+ 421us) client_negotiation.cc:769] Sending connection context
0809 00:46:01.884393 (+ 280us) client_negotiation.cc:240] Negotiation successful
0809 00:46:01.884920 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":279,"threads_started":1}
I20260809 00:46:01.887866 1013 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39153
I20260809 00:46:01.888231 1013 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:01.889092 1013 heartbeater.cc:511] Master 127.28.92.190:39153 requested a full tablet report, sending...
I20260809 00:46:01.890682 503 ts_manager.cc:194] Registered new tserver with Master: aebd04bafa284caea2cec8b29ba7b4f5 (127.28.92.130:39617)
I20260809 00:46:01.891464 503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:35599
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:46:01.920580 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39153
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:02.244643 1020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:02.244942 1020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:02.245085 1020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:02.252266 1020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:02.252385 1020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:02.252540 1020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:02.262145 1020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39153
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:02.263386 1020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:02.264667 1020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:02.277073 1025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:02.277132 1030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:02.277148 1027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:02.277979 1020 server_base.cc:1034] running on GCE node
I20260809 00:46:02.278597 1020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:02.279469 1020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:02.280678 1020 hybrid_clock.cc:648] HybridClock initialized: now 1786236362280619 us; error 45 us; skew 500 ppm
I20260809 00:46:02.281013 1020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:02 dist-test-slave-t7g5 krb5kdc[429](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236362, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:02.284044 1020 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:46:02.286073 1020 webserver.cc:460] Webserver started at http://127.28.92.131:42591/ using document root <none> and password file <none>
I20260809 00:46:02.286759 1020 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:02.286885 1020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:02.287189 1020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:02.290117 1020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "9be5b93fc2f04daa81ef14df90c18e1c"
format_stamp: "Formatted at 2026-08-09 00:46:02 on dist-test-slave-t7g5"
server_key: "d62bf1c676bcd1c05627942a7d60a01a"
server_key_iv: "e130fe7b876a7be8c088da2dfc158ca9"
server_key_version: "encryptionkey@0"
I20260809 00:46:02.290887 1020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "9be5b93fc2f04daa81ef14df90c18e1c"
format_stamp: "Formatted at 2026-08-09 00:46:02 on dist-test-slave-t7g5"
server_key: "d62bf1c676bcd1c05627942a7d60a01a"
server_key_iv: "e130fe7b876a7be8c088da2dfc158ca9"
server_key_version: "encryptionkey@0"
I20260809 00:46:02.296048 1020 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:02.299463 1043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:02.300704 1020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:02.300856 1020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "9be5b93fc2f04daa81ef14df90c18e1c"
format_stamp: "Formatted at 2026-08-09 00:46:02 on dist-test-slave-t7g5"
server_key: "d62bf1c676bcd1c05627942a7d60a01a"
server_key_iv: "e130fe7b876a7be8c088da2dfc158ca9"
server_key_version: "encryptionkey@0"
I20260809 00:46:02.301056 1020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:02.320504 1020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:02.324432 1020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:02.324707 1020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:02.325706 1020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:02.327050 1020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:02.327124 1020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:02.327219 1020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:02.327263 1020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:02.357302 1020 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:37201
I20260809 00:46:02.357353 1205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:37201 every 8 connection(s)
I20260809 00:46:02.358568 1020 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:02.359762 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 1020
I20260809 00:46:02.359968 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:02.360522 29042 external_mini_cluster.cc:1428] Setting key fc01dbec5c96fbea7c0dbe00574a8a30
Aug 09 00:46:02 dist-test-slave-t7g5 krb5kdc[429](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236362, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:02.380069 788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:02.361269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:58999 (local address 127.28.92.190:39153)
0809 00:46:02.361437 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:02.361442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:02.362878 (+ 1436us) server_negotiation.cc:407] Connection header received
0809 00:46:02.364793 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:02.364798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:02.364882 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:02.364968 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:02.366504 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:02.367249 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:02.369552 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:02.370035 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:02.370130 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:02.374063 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:02.374068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:02.374072 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:02.374112 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:02.377042 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:02.377774 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:02.377780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:02.377784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:02.377923 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:02.378351 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:02.378354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:02.378356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:02.378648 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:02.378781 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:02.379500 (+ 719us) server_negotiation.cc:299] Negotiation successful
0809 00:46:02.379737 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:46:02.381004 1215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:02.361954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39153 (local address 127.28.92.131:58999)
0809 00:46:02.362736 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:02.362780 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:02.364544 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:02.365216 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:02.365223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:02.365784 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:02.366342 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:02.366359 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:02.367427 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:02.367433 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:02.369402 (+ 1969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:02.369418 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:02.370266 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:02.370276 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:02.370559 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:02.371242 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:02.371277 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:02.373849 (+ 2572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:02.377180 (+ 3331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:02.377190 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:02.377208 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:02.377636 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:02.378031 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:02.378036 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:02.378040 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:02.378234 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:02.378772 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:02.378781 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:02.379124 (+ 343us) client_negotiation.cc:769] Sending connection context
0809 00:46:02.379364 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 00:46:02.379894 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":296,"threads_started":1}
I20260809 00:46:02.382266 1208 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39153
I20260809 00:46:02.382573 1208 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:02.383279 1208 heartbeater.cc:511] Master 127.28.92.190:39153 requested a full tablet report, sending...
I20260809 00:46:02.384698 503 ts_manager.cc:194] Registered new tserver with Master: 9be5b93fc2f04daa81ef14df90c18e1c (127.28.92.131:37201)
I20260809 00:46:02.385502 503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:58999
I20260809 00:46:02.388406 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:46:02.400965 784 heartbeater.cc:503] Master 127.28.92.190:39153 was elected leader, sending a full tablet report...
W20260809 00:46:02.422685 788 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:02.420240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58738 (local address 127.28.92.190:39153)
0809 00:46:02.420483 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:02.420489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:02.420757 (+ 268us) server_negotiation.cc:407] Connection header received
0809 00:46:02.420921 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:02.420925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:02.420993 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:02.421078 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:02.422407 (+ 1329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58738: BlockingRecv error: recv got EOF from 127.0.0.1:58738 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:46:02.425851 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 587
W20260809 00:46:02.428755 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 587: Not authorized: Client connection negotiation failed: client connection to 127.28.92.129:40207: server requires authentication, but client does not have Kerberos credentials available
I20260809 00:46:02.428927 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 587
I20260809 00:46:02.455348 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 798
W20260809 00:46:02.458248 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 798: Not authorized: Client connection negotiation failed: client connection to 127.28.92.130:39617: server requires authentication, but client does not have Kerberos credentials available
I20260809 00:46:02.458446 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 798
I20260809 00:46:02.479844 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1020
W20260809 00:46:02.482887 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1020: Not authorized: Client connection negotiation failed: client connection to 127.28.92.131:37201: server requires authentication, but client does not have Kerberos credentials available
I20260809 00:46:02.483040 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 1020
I20260809 00:46:02.500591 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 449
I20260809 00:46:02.501879 542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:02.603610 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 449
2026-08-09T00:46:02Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3664 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:02 dist-test-slave-t7g5 krb5kdc[1234](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:02 dist-test-slave-t7g5 krb5kdc[1234](info): set up 2 sockets
Aug 09 00:46:02 dist-test-slave-t7g5 krb5kdc[1234](info): commencing operation
krb5kdc: starting...
W20260809 00:46:03.809455 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.006s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:03 dist-test-slave-t7g5 krb5kdc[1234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:04.014993 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:42229
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:04.344821 1257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:04.345144 1257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:04.345288 1257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:04.352748 1257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:04.352883 1257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:04.352967 1257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:04.353045 1257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:04.353117 1257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:04.363062 1257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:42229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:04.364401 1257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:04.365746 1257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:04.376960 1265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:04.376905 1269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:04.376937 1267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:04.377902 1257 server_base.cc:1034] running on GCE node
I20260809 00:46:04.378660 1257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:04.379977 1257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:04.381182 1257 hybrid_clock.cc:648] HybridClock initialized: now 1786236364381138 us; error 32 us; skew 500 ppm
I20260809 00:46:04.381505 1257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:04 dist-test-slave-t7g5 krb5kdc[1234](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236364, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:04.388736 1257 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:04.390290 1257 webserver.cc:460] Webserver started at http://127.28.92.190:36835/ using document root <none> and password file <none>
I20260809 00:46:04.390970 1257 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:04.391089 1257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:04.391393 1257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:04.394423 1257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "3c651d61cde94372b050cbc8d9a1356b"
format_stamp: "Formatted at 2026-08-09 00:46:04 on dist-test-slave-t7g5"
server_key: "b0eaad39f324889792a7e56218202369"
server_key_iv: "f26ee93986d124d9529cdddc7070e4d9"
server_key_version: "encryptionkey@0"
I20260809 00:46:04.395207 1257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "3c651d61cde94372b050cbc8d9a1356b"
format_stamp: "Formatted at 2026-08-09 00:46:04 on dist-test-slave-t7g5"
server_key: "b0eaad39f324889792a7e56218202369"
server_key_iv: "f26ee93986d124d9529cdddc7070e4d9"
server_key_version: "encryptionkey@0"
I20260809 00:46:04.400453 1257 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:46:04.403877 1280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:04.405200 1257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:46:04.405364 1257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "3c651d61cde94372b050cbc8d9a1356b"
format_stamp: "Formatted at 2026-08-09 00:46:04 on dist-test-slave-t7g5"
server_key: "b0eaad39f324889792a7e56218202369"
server_key_iv: "f26ee93986d124d9529cdddc7070e4d9"
server_key_version: "encryptionkey@0"
I20260809 00:46:04.405550 1257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:04.421422 1257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:04.425297 1257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:04.425554 1257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:04.442730 1257 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:42229
I20260809 00:46:04.442764 1357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:42229 every 8 connection(s)
I20260809 00:46:04.444077 1257 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:04.445696 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 1257
I20260809 00:46:04.445933 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:04.446750 29042 external_mini_cluster.cc:1428] Setting key 9ac08713d90ea2bdb88dcf48320a0943
I20260809 00:46:04.448707 1358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 00:46:04 dist-test-slave-t7g5 krb5kdc[1234](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236363, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:04.462546 1358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b: Bootstrap starting.
I20260809 00:46:04.465891 1358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:04.467168 1358 log.cc:824] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:04.469851 1361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:04.448666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38882 (local address 127.28.92.190:42229)
0809 00:46:04.449479 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:04.449494 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:04.449542 (+ 48us) server_negotiation.cc:407] Connection header received
0809 00:46:04.451313 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:04.451338 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:04.451741 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:04.452114 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:04.454070 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:04.455420 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:04.457214 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:04.457942 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:04.458073 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:04.462773 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:04.462782 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:04.462797 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:04.462834 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:04.465743 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:04.466548 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:04.466555 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:04.466561 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:04.466733 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:04.467157 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:04.467161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:04.467163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:04.467834 (+ 671us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:04.468132 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:04.468526 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 00:46:04.468869 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":340,"threads_started":1}
I20260809 00:46:04.470290 1358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b: No bootstrap required, opened a new log
I20260809 00:46:04.473502 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:46:04.477537 1358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c651d61cde94372b050cbc8d9a1356b" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42229 } }
I20260809 00:46:04.477923 1358 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:04.478020 1358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c651d61cde94372b050cbc8d9a1356b, State: Initialized, Role: FOLLOWER
I20260809 00:46:04.478544 1358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c651d61cde94372b050cbc8d9a1356b" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42229 } }
I20260809 00:46:04.478765 1358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:04.478893 1358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:04.479058 1358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:04.481104 1358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c651d61cde94372b050cbc8d9a1356b" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42229 } }
I20260809 00:46:04.481572 1358 leader_election.cc:302] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c651d61cde94372b050cbc8d9a1356b; no voters:
I20260809 00:46:04.482190 1358 leader_election.cc:288] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:04.482301 1365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:04.484480 1358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:04.489172 1365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [term 1 LEADER]: Becoming Leader. State: Replica: 3c651d61cde94372b050cbc8d9a1356b, State: Running, Role: LEADER
I20260809 00:46:04.489684 1365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c651d61cde94372b050cbc8d9a1356b" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42229 } }
I20260809 00:46:04.492352 1370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c651d61cde94372b050cbc8d9a1356b. Latest consensus state: current_term: 1 leader_uuid: "3c651d61cde94372b050cbc8d9a1356b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c651d61cde94372b050cbc8d9a1356b" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42229 } } }
I20260809 00:46:04.492499 1366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c651d61cde94372b050cbc8d9a1356b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c651d61cde94372b050cbc8d9a1356b" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 42229 } } }
I20260809 00:46:04.492966 1366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:04.497529 1370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:04.499545 1387 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 00:46:04.500782 1388 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:04.506044 1388 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:04.515734 1388 catalog_manager.cc:1347] Generated new cluster ID: b3ec229d821d43e5b53bfb74fbfc2915
I20260809 00:46:04.515865 1388 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:04.524080 1361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:04.516142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.28.92.190:42229)
0809 00:46:04.516319 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:04.516326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:04.516893 (+ 567us) server_negotiation.cc:407] Connection header received
0809 00:46:04.517071 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:04.517076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:04.517149 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:04.517235 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:04.518360 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:04.519475 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:04.520860 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:04.521288 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:04.521401 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:04.522463 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:04.522469 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:04.522473 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:04.523256 (+ 783us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:04.523302 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:04.523331 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:04.523424 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:04.523583 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 00:46:04.523689 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:46:04.526908 1388 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:04.528191 1388 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:04.541006 1388 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c651d61cde94372b050cbc8d9a1356b: Generated new TSK 0
I20260809 00:46:04.541927 1388 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:46:04.554549 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1257
I20260809 00:46:04.555763 1352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:04.644553 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 1257
2026-08-09T00:46:04Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2034 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:04 dist-test-slave-t7g5 krb5kdc[1413](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:04 dist-test-slave-t7g5 krb5kdc[1413](info): set up 2 sockets
Aug 09 00:46:04 dist-test-slave-t7g5 krb5kdc[1413](info): commencing operation
krb5kdc: starting...
W20260809 00:46:05.864252 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.005s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:06 dist-test-slave-t7g5 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:06.074910 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34993
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34993
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:06.401189 1433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:06.401476 1433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:06.401594 1433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:06.408723 1433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:06.408843 1433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:06.408936 1433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:06.409015 1433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:06.409085 1433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:06.419194 1433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:06.420567 1433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:06.421923 1433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:06.433336 1452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:06.433364 1444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:06.433530 1446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:06.434048 1433 server_base.cc:1034] running on GCE node
I20260809 00:46:06.434800 1433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:06.436204 1433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:06.437412 1433 hybrid_clock.cc:648] HybridClock initialized: now 1786236366437347 us; error 50 us; skew 500 ppm
I20260809 00:46:06.437781 1433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:06 dist-test-slave-t7g5 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236366, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:06.440735 1433 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:06.442149 1433 webserver.cc:460] Webserver started at http://127.28.92.190:40265/ using document root <none> and password file <none>
I20260809 00:46:06.442816 1433 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:06.442937 1433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:06.443243 1433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:06.446252 1433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "ced8082651644f5586692818c113f364"
format_stamp: "Formatted at 2026-08-09 00:46:06 on dist-test-slave-t7g5"
server_key: "fccd219cd5393aaa0c5cc5e78d3d24c5"
server_key_iv: "bcf2fbba32c1a9757edd28952b5df92b"
server_key_version: "encryptionkey@0"
I20260809 00:46:06.447019 1433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "ced8082651644f5586692818c113f364"
format_stamp: "Formatted at 2026-08-09 00:46:06 on dist-test-slave-t7g5"
server_key: "fccd219cd5393aaa0c5cc5e78d3d24c5"
server_key_iv: "bcf2fbba32c1a9757edd28952b5df92b"
server_key_version: "encryptionkey@0"
I20260809 00:46:06.452263 1433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:06.455713 1463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:06.457028 1433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 00:46:06.457196 1433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "ced8082651644f5586692818c113f364"
format_stamp: "Formatted at 2026-08-09 00:46:06 on dist-test-slave-t7g5"
server_key: "fccd219cd5393aaa0c5cc5e78d3d24c5"
server_key_iv: "bcf2fbba32c1a9757edd28952b5df92b"
server_key_version: "encryptionkey@0"
I20260809 00:46:06.457379 1433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:06.474960 1433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:06.478840 1433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:06.479126 1433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:06.496354 1433 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34993
I20260809 00:46:06.496394 1538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34993 every 8 connection(s)
I20260809 00:46:06.497726 1433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:06.500255 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 1433
I20260809 00:46:06.500451 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:06.501073 29042 external_mini_cluster.cc:1428] Setting key d6e70bb6ff1310802676efcda7170eef
I20260809 00:46:06.501451 1539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:06.515535 1539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364: Bootstrap starting.
Aug 09 00:46:06 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:06.518925 1539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:06.520000 1539 log.cc:824] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:06.522873 1539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364: No bootstrap required, opened a new log
I20260809 00:46:06.524030 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:06.503048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56932 (local address 127.28.92.190:34993)
0809 00:46:06.503833 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:06.503853 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:06.503908 (+ 55us) server_negotiation.cc:407] Connection header received
0809 00:46:06.506028 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:06.506051 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:06.506433 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:06.506766 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:06.508466 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:06.509750 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:06.511411 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:06.512121 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:06.512261 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:06.516949 (+ 4688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:06.516959 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:06.516973 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:06.517015 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:06.519993 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:06.520679 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:06.520685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:06.520691 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:06.520876 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:06.521254 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:06.521258 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:06.521260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:06.521831 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:06.522125 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:06.522560 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 00:46:06.523009 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":344,"threads_started":1}
I20260809 00:46:06.530843 1539 raft_consensus.cc:348] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced8082651644f5586692818c113f364" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34993 } }
I20260809 00:46:06.531222 1539 raft_consensus.cc:374] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:06.531333 1539 raft_consensus.cc:729] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ced8082651644f5586692818c113f364, State: Initialized, Role: FOLLOWER
I20260809 00:46:06.531857 1539 consensus_queue.cc:260] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced8082651644f5586692818c113f364" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34993 } }
I20260809 00:46:06.532074 1539 raft_consensus.cc:388] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:06.532202 1539 raft_consensus.cc:482] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:06.532353 1539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:06.534786 1539 raft_consensus.cc:504] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced8082651644f5586692818c113f364" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34993 } }
I20260809 00:46:06.535267 1539 leader_election.cc:302] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ced8082651644f5586692818c113f364; no voters:
I20260809 00:46:06.535810 1539 leader_election.cc:288] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:06.535939 1544 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:06.536641 1544 raft_consensus.cc:686] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [term 1 LEADER]: Becoming Leader. State: Replica: ced8082651644f5586692818c113f364, State: Running, Role: LEADER
I20260809 00:46:06.537142 1544 consensus_queue.cc:237] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced8082651644f5586692818c113f364" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34993 } }
I20260809 00:46:06.537812 1539 sys_catalog.cc:564] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:06.540083 1545 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ced8082651644f5586692818c113f364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced8082651644f5586692818c113f364" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34993 } } }
I20260809 00:46:06.540133 1546 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ced8082651644f5586692818c113f364. Latest consensus state: current_term: 1 leader_uuid: "ced8082651644f5586692818c113f364" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced8082651644f5586692818c113f364" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34993 } } }
I20260809 00:46:06.540458 1545 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:06.540458 1546 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:06.542121 1554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:06.547140 1554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:06.559692 1554 catalog_manager.cc:1347] Generated new cluster ID: ff352f7bef6d4ae48121213b9fd0ce7c
I20260809 00:46:06.559814 1554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:06.572503 1554 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:06.573814 1554 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:06.580683 1554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ced8082651644f5586692818c113f364: Generated new TSK 0
I20260809 00:46:06.581717 1554 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:46:06.639788 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34993
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:06.960460 1572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:06.960733 1572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:06.960879 1572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:06.967926 1572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:06.968034 1572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:06.968187 1572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:06.977489 1572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:06.978688 1572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:06.979965 1572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:06.992344 1580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:06.992413 1581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:06.992446 1591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:06.993578 1572 server_base.cc:1034] running on GCE node
I20260809 00:46:06.994203 1572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:06.995055 1572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:06.996253 1572 hybrid_clock.cc:648] HybridClock initialized: now 1786236366996204 us; error 36 us; skew 500 ppm
I20260809 00:46:06.996534 1572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:06 dist-test-slave-t7g5 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236366, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:06.999610 1572 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:46:07.000964 1572 webserver.cc:460] Webserver started at http://127.28.92.129:43913/ using document root <none> and password file <none>
I20260809 00:46:07.001601 1572 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:07.001744 1572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:07.002048 1572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:07.004873 1572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "85bb39d8f5114251bda4e3b7f84488d8"
format_stamp: "Formatted at 2026-08-09 00:46:07 on dist-test-slave-t7g5"
server_key: "40998fffcbf7bbb15608d9257658a087"
server_key_iv: "1eaed0c8d79e767c7313eac05938bd22"
server_key_version: "encryptionkey@0"
I20260809 00:46:07.005642 1572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "85bb39d8f5114251bda4e3b7f84488d8"
format_stamp: "Formatted at 2026-08-09 00:46:07 on dist-test-slave-t7g5"
server_key: "40998fffcbf7bbb15608d9257658a087"
server_key_iv: "1eaed0c8d79e767c7313eac05938bd22"
server_key_version: "encryptionkey@0"
I20260809 00:46:07.010671 1572 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:46:07.014010 1601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:07.015295 1572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 00:46:07.015436 1572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "85bb39d8f5114251bda4e3b7f84488d8"
format_stamp: "Formatted at 2026-08-09 00:46:07 on dist-test-slave-t7g5"
server_key: "40998fffcbf7bbb15608d9257658a087"
server_key_iv: "1eaed0c8d79e767c7313eac05938bd22"
server_key_version: "encryptionkey@0"
I20260809 00:46:07.015630 1572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:07.034878 1572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:07.038862 1572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:07.039146 1572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:07.040107 1572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:07.041411 1572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:07.041488 1572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:07.041620 1572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:07.041703 1572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260809 00:46:07.070849 1572 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:42473
I20260809 00:46:07.070901 1767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:42473 every 8 connection(s)
I20260809 00:46:07.072109 1572 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:07.080847 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 1572
I20260809 00:46:07.081084 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:07.081732 29042 external_mini_cluster.cc:1428] Setting key 6ab3a5d5e1dd919b7c22f30f5c728aad
Aug 09 00:46:07 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236366, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:07.091950 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:07.074487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54637 (local address 127.28.92.190:34993)
0809 00:46:07.074908 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:07.074912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:07.075755 (+ 843us) server_negotiation.cc:407] Connection header received
0809 00:46:07.077504 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:07.077511 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:07.077601 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:07.077728 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:07.079158 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.079900 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.081615 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.082091 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.082207 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:07.086342 (+ 4135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:07.086348 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:07.086351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:07.086382 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:07.088727 (+ 2345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:07.089556 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:07.089559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:07.089562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:07.089705 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:07.090129 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:07.090131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:07.090133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:07.090404 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:07.090509 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:07.091345 (+ 836us) server_negotiation.cc:299] Negotiation successful
0809 00:46:07.091579 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":224,"threads_started":1}
I20260809 00:46:07.092779 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:07.074895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34993 (local address 127.28.92.129:54637)
0809 00:46:07.075597 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:07.075641 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:07.077234 (+ 1593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:07.077970 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:07.077978 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:07.078466 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:07.078991 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:07.079008 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.080053 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.080057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:07.081479 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:07.081493 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.082318 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.082327 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:07.082612 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:07.083460 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:07.083500 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:07.086120 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:07.088870 (+ 2750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:07.088879 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:07.088897 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:07.089459 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:07.089799 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:07.089803 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:07.089806 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:07.090041 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:07.090532 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:07.090540 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:07.090982 (+ 442us) client_negotiation.cc:769] Sending connection context
0809 00:46:07.091243 (+ 261us) client_negotiation.cc:240] Negotiation successful
0809 00:46:07.091657 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":251,"threads_started":1}
I20260809 00:46:07.094342 1768 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34993
I20260809 00:46:07.094646 1768 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:07.095374 1768 heartbeater.cc:511] Master 127.28.92.190:34993 requested a full tablet report, sending...
I20260809 00:46:07.097506 1483 ts_manager.cc:194] Registered new tserver with Master: 85bb39d8f5114251bda4e3b7f84488d8 (127.28.92.129:42473)
I20260809 00:46:07.099066 1483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:54637
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:46:07.128661 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34993
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:07.455623 1777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:07.455940 1777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:07.456080 1777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:07.463304 1777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:07.463431 1777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:07.463589 1777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:07.473096 1777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:07.474411 1777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:07.475757 1777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:07.488065 1789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:07.488307 1794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:07.488312 1792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:07.489399 1777 server_base.cc:1034] running on GCE node
I20260809 00:46:07.490059 1777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:07.490983 1777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:07.492197 1777 hybrid_clock.cc:648] HybridClock initialized: now 1786236367492146 us; error 39 us; skew 500 ppm
I20260809 00:46:07.492527 1777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:07 dist-test-slave-t7g5 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236367, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:07.495644 1777 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:46:07.497154 1777 webserver.cc:460] Webserver started at http://127.28.92.130:39925/ using document root <none> and password file <none>
I20260809 00:46:07.497884 1777 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:07.498006 1777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:07.498310 1777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:07.501197 1777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "2d3265f457ac4ff794f59c30bbdf2c1c"
format_stamp: "Formatted at 2026-08-09 00:46:07 on dist-test-slave-t7g5"
server_key: "6da604582be16ea39ad8c831f02bb2c4"
server_key_iv: "f6af8807e3cc810b8f10f278b91a13e3"
server_key_version: "encryptionkey@0"
I20260809 00:46:07.502084 1777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "2d3265f457ac4ff794f59c30bbdf2c1c"
format_stamp: "Formatted at 2026-08-09 00:46:07 on dist-test-slave-t7g5"
server_key: "6da604582be16ea39ad8c831f02bb2c4"
server_key_iv: "f6af8807e3cc810b8f10f278b91a13e3"
server_key_version: "encryptionkey@0"
I20260809 00:46:07.507508 1777 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:07.511080 1811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:07.512415 1777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:46:07.512585 1777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "2d3265f457ac4ff794f59c30bbdf2c1c"
format_stamp: "Formatted at 2026-08-09 00:46:07 on dist-test-slave-t7g5"
server_key: "6da604582be16ea39ad8c831f02bb2c4"
server_key_iv: "f6af8807e3cc810b8f10f278b91a13e3"
server_key_version: "encryptionkey@0"
I20260809 00:46:07.512778 1777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:07.551186 1777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:07.555233 1777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:07.555531 1777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:07.556541 1777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:07.557914 1777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:07.558005 1777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:07.558122 1777 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:07.558176 1777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:07.588228 1777 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:41333
I20260809 00:46:07.588263 1991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:41333 every 8 connection(s)
I20260809 00:46:07.589548 1777 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:07.598654 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 1777
I20260809 00:46:07.598821 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:07.599323 29042 external_mini_cluster.cc:1428] Setting key 478c2e7201cb4489b0f2e21bda0198ee
Aug 09 00:46:07 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236367, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:07.609345 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:07.592061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:42379 (local address 127.28.92.190:34993)
0809 00:46:07.592239 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:07.592243 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:07.593408 (+ 1165us) server_negotiation.cc:407] Connection header received
0809 00:46:07.595280 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:07.595285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:07.595357 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:07.595438 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:07.596829 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.597551 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.599154 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.599767 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.599904 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:07.603740 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:07.603746 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:07.603749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:07.603783 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:07.606294 (+ 2511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:07.607110 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:07.607114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:07.607116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:07.607251 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:07.607681 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:07.607684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:07.607686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:07.607937 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:07.608045 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:07.608780 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 00:46:07.609016 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:46:07.610158 1994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:07.592536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34993 (local address 127.28.92.130:42379)
0809 00:46:07.593222 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:07.593282 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:07.595013 (+ 1731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:07.595637 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:07.595644 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:07.596148 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:07.596693 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:07.596715 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.597710 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.597714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:07.599006 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:07.599018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:07.600008 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:07.600016 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:07.600284 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:07.600908 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:07.600931 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:07.603497 (+ 2566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:07.606430 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:07.606446 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:07.606463 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:07.607008 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:07.607342 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:07.607346 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:07.607348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:07.607590 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:07.608053 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:07.608061 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:07.608407 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 00:46:07.608642 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 00:46:07.609036 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":257,"threads_started":1}
I20260809 00:46:07.611487 1992 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34993
I20260809 00:46:07.611819 1992 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:07.612694 1992 heartbeater.cc:511] Master 127.28.92.190:34993 requested a full tablet report, sending...
I20260809 00:46:07.614324 1483 ts_manager.cc:194] Registered new tserver with Master: 2d3265f457ac4ff794f59c30bbdf2c1c (127.28.92.130:41333)
I20260809 00:46:07.615121 1483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:42379
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:46:07.646575 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34993
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:35847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:07.967105 1997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:07.967413 1997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:07.967545 1997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:07.974809 1997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:07.974931 1997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:07.975085 1997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:07.985474 1997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34993
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:07.986961 1997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:07.988353 1997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:08.001842 2005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:08.001879 2007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:08.001909 2009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:08.002696 1997 server_base.cc:1034] running on GCE node
I20260809 00:46:08.003309 1997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:08.004263 1997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:08.005471 1997 hybrid_clock.cc:648] HybridClock initialized: now 1786236368005412 us; error 46 us; skew 500 ppm
I20260809 00:46:08.005848 1997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:08.009074 1997 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:46:08.010717 1997 webserver.cc:460] Webserver started at http://127.28.92.131:33419/ using document root <none> and password file <none>
I20260809 00:46:08.011413 1997 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:08.011516 1997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:08.011777 1997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:08.014904 1997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "f74517518b0441988f695ff4af70edb3"
format_stamp: "Formatted at 2026-08-09 00:46:08 on dist-test-slave-t7g5"
server_key: "26937ec9734b4f5f308bfac40f4ba694"
server_key_iv: "a699c8494d209c6c849302bb3589e8bf"
server_key_version: "encryptionkey@0"
I20260809 00:46:08.015802 1997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "f74517518b0441988f695ff4af70edb3"
format_stamp: "Formatted at 2026-08-09 00:46:08 on dist-test-slave-t7g5"
server_key: "26937ec9734b4f5f308bfac40f4ba694"
server_key_iv: "a699c8494d209c6c849302bb3589e8bf"
server_key_version: "encryptionkey@0"
I20260809 00:46:08.021353 1997 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:46:08.024947 2018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:08.026351 1997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:08.026527 1997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "f74517518b0441988f695ff4af70edb3"
format_stamp: "Formatted at 2026-08-09 00:46:08 on dist-test-slave-t7g5"
server_key: "26937ec9734b4f5f308bfac40f4ba694"
server_key_iv: "a699c8494d209c6c849302bb3589e8bf"
server_key_version: "encryptionkey@0"
I20260809 00:46:08.026727 1997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:08.046859 1997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:08.051121 1997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:08.051404 1997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:08.052366 1997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:08.053786 1997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:08.053869 1997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:08.054005 1997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:08.054062 1997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:08.083968 1997 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:35007
I20260809 00:46:08.083971 2191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:35007 every 8 connection(s)
I20260809 00:46:08.085228 1997 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:08.094202 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 1997
I20260809 00:46:08.094385 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:08.094933 29042 external_mini_cluster.cc:1428] Setting key 0cb954e3596165751aa1d0ee25618cbe
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:08.101960 1768 heartbeater.cc:503] Master 127.28.92.190:34993 was elected leader, sending a full tablet report...
I20260809 00:46:08.104617 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:08.087658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:49651 (local address 127.28.92.190:34993)
0809 00:46:08.087855 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:08.087861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:08.089005 (+ 1144us) server_negotiation.cc:407] Connection header received
0809 00:46:08.090752 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:08.090756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:08.090854 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:08.090934 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:08.092380 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.093111 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.095072 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.095499 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.095599 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:08.099125 (+ 3526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:08.099130 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:08.099134 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:08.099168 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:08.101411 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.102286 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.102292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.102295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.102484 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.102938 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.102942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.102946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.103316 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:08.103465 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:08.104188 (+ 723us) server_negotiation.cc:299] Negotiation successful
0809 00:46:08.104365 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:46:08.105531 2194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:08.088148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34993 (local address 127.28.92.131:49651)
0809 00:46:08.088839 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:08.088878 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:08.090494 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:08.091199 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:08.091207 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:08.091692 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:08.092244 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:08.092261 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.093225 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.093228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:08.094903 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:08.094920 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.095718 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.095725 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:08.095939 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:08.096616 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:08.096653 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:08.098929 (+ 2276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:08.101543 (+ 2614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:08.101550 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:08.101564 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:08.102173 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:08.102592 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:08.102596 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:08.102599 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:08.102820 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:08.103447 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:08.103455 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:08.103856 (+ 401us) client_negotiation.cc:769] Sending connection context
0809 00:46:08.104092 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 00:46:08.104484 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":265,"threads_started":1}
I20260809 00:46:08.106797 2192 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34993
I20260809 00:46:08.107070 2192 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:08.107750 2192 heartbeater.cc:511] Master 127.28.92.190:34993 requested a full tablet report, sending...
I20260809 00:46:08.109159 1483 ts_manager.cc:194] Registered new tserver with Master: f74517518b0441988f695ff4af70edb3 (127.28.92.131:35007)
I20260809 00:46:08.110113 1483 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:49651
I20260809 00:46:08.110536 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:08.161744 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:08.148338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56938 (local address 127.28.92.190:34993)
0809 00:46:08.148520 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:08.148525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:08.148995 (+ 470us) server_negotiation.cc:407] Connection header received
0809 00:46:08.149147 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:08.149151 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:08.149215 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:08.149303 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:08.150708 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.151448 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.152606 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.153020 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.153111 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:08.156796 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:08.156801 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:08.156805 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:08.156838 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:08.159108 (+ 2270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.159699 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.159704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.159706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.159841 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.160200 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.160204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.160206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.160608 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:08.160830 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:08.161157 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 00:46:08.161369 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 00:46:08.162335 1483 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56938
I20260809 00:46:08.163821 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1572
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:08.178689 2209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:08.164984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42676 (local address 127.28.92.129:42473)
0809 00:46:08.165570 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:08.165577 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:08.165602 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:46:08.165677 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:08.165685 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:08.165931 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:08.166050 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:08.167071 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.168066 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.169141 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.169737 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.169829 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:08.173259 (+ 3430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:08.173270 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:08.173284 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:08.173315 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:08.176014 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.176623 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.176630 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.176632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.176755 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.177115 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.177119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.177121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.177463 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:08.177824 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:08.178093 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 00:46:08.178357 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":272,"threads_started":1}
W20260809 00:46:08.180022 1758 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42676
W20260809 00:46:08.181044 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1572: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:46:08.181258 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 1572
I20260809 00:46:08.207787 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1777
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:46:08.224155 2212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:08.208753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.28.92.130:41333)
0809 00:46:08.209417 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:08.209424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:08.209460 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:46:08.209533 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:08.209540 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:08.209806 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:08.209944 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:08.211149 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.212195 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.213404 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.214037 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.214138 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:08.218310 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:08.218322 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:08.218339 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:08.218379 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:08.221233 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.221960 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.221968 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.221970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.222109 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.222492 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.222496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.222498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.222852 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:08.223151 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:08.223530 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 00:46:08.223803 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":370,"threads_started":1}
W20260809 00:46:08.225430 1986 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52922
W20260809 00:46:08.226711 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1777: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:46:08.226859 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 1777
I20260809 00:46:08.247630 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1997
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[1413](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236368, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:46:08.264212 2214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:08.248582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60152 (local address 127.28.92.131:35007)
0809 00:46:08.249229 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:08.249236 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:08.249266 (+ 30us) server_negotiation.cc:407] Connection header received
0809 00:46:08.249332 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:08.249338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:08.249544 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:08.249726 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:08.251082 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.252144 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.253717 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:08.254538 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:08.254672 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:08.259081 (+ 4409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:08.259093 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:08.259109 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:08.259147 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:08.261918 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.262540 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.262547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.262549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.262673 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:08.262939 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:08.262941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:08.262943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:08.263286 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:08.263520 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:08.263721 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 00:46:08.263924 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":339,"threads_started":1}
W20260809 00:46:08.265439 2185 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60152
W20260809 00:46:08.266503 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1997: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:46:08.266665 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 1997
I20260809 00:46:08.288036 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 1433
I20260809 00:46:08.289240 1533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:08.390558 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 1433
2026-08-09T00:46:08Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3753 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[2218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[2218](info): set up 2 sockets
Aug 09 00:46:08 dist-test-slave-t7g5 krb5kdc[2218](info): commencing operation
krb5kdc: starting...
W20260809 00:46:09.597205 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:09 dist-test-slave-t7g5 krb5kdc[2218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:09.808933 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34681
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34681
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:10.135854 2238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:10.136178 2238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:10.136300 2238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:10.143630 2238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:10.143761 2238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:10.143826 2238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:10.143911 2238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:10.143980 2238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:10.154057 2238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:10.155498 2238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:10.156886 2238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:10.168468 2244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:10.168521 2245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:10.168527 2248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:10.169397 2238 server_base.cc:1034] running on GCE node
I20260809 00:46:10.170210 2238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:10.171589 2238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:10.172804 2238 hybrid_clock.cc:648] HybridClock initialized: now 1786236370172758 us; error 25 us; skew 500 ppm
I20260809 00:46:10.173134 2238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:10 dist-test-slave-t7g5 krb5kdc[2218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236370, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:10.179972 2238 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:10.181558 2238 webserver.cc:460] Webserver started at http://127.28.92.190:39659/ using document root <none> and password file <none>
I20260809 00:46:10.182312 2238 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:10.182440 2238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:10.182754 2238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:10.185856 2238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "50b0c491b0f7410a903b8eddb1466ae2"
format_stamp: "Formatted at 2026-08-09 00:46:10 on dist-test-slave-t7g5"
server_key: "bf831083f51fdca09b1899fae089735c"
server_key_iv: "40f9dba5f25ca1711bea16820f17f528"
server_key_version: "encryptionkey@0"
I20260809 00:46:10.186653 2238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "50b0c491b0f7410a903b8eddb1466ae2"
format_stamp: "Formatted at 2026-08-09 00:46:10 on dist-test-slave-t7g5"
server_key: "bf831083f51fdca09b1899fae089735c"
server_key_iv: "40f9dba5f25ca1711bea16820f17f528"
server_key_version: "encryptionkey@0"
I20260809 00:46:10.192759 2238 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260809 00:46:10.197019 2261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:10.198436 2238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:10.198611 2238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "50b0c491b0f7410a903b8eddb1466ae2"
format_stamp: "Formatted at 2026-08-09 00:46:10 on dist-test-slave-t7g5"
server_key: "bf831083f51fdca09b1899fae089735c"
server_key_iv: "40f9dba5f25ca1711bea16820f17f528"
server_key_version: "encryptionkey@0"
I20260809 00:46:10.198822 2238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:10.213748 2238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:10.218127 2238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:10.218448 2238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:10.236339 2238 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34681
I20260809 00:46:10.236341 2343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34681 every 8 connection(s)
I20260809 00:46:10.237836 2238 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:10.241873 2344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:10.247434 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 2238
I20260809 00:46:10.247677 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:10.248510 29042 external_mini_cluster.cc:1428] Setting key 95a93aa9df35f68ab132b3d0caa35976
I20260809 00:46:10.253490 2344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2: Bootstrap starting.
I20260809 00:46:10.257195 2344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:10.258242 2344 log.cc:824] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:10.261879 2344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2: No bootstrap required, opened a new log
Aug 09 00:46:10 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236369, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:10.270931 2344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50b0c491b0f7410a903b8eddb1466ae2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34681 } }
I20260809 00:46:10.271303 2344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:10.271418 2344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b0c491b0f7410a903b8eddb1466ae2, State: Initialized, Role: FOLLOWER
I20260809 00:46:10.272096 2350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:10.250728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45102 (local address 127.28.92.190:34681)
0809 00:46:10.251609 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:10.251621 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:10.251665 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:46:10.253354 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:10.253378 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:10.253837 (+ 459us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:10.254148 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:10.256008 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:10.257320 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:10.258641 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:10.259412 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:10.259582 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:10.264519 (+ 4937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:10.264527 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:10.264545 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:10.264585 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:10.267726 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:10.268536 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:10.268542 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:10.268548 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:10.268725 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:10.269144 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:10.269147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:10.269149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:10.269809 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:10.270032 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:10.270485 (+ 453us) server_negotiation.cc:299] Negotiation successful
0809 00:46:10.270873 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":432,"threads_started":1}
I20260809 00:46:10.271996 2344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50b0c491b0f7410a903b8eddb1466ae2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34681 } }
I20260809 00:46:10.272239 2344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:10.272411 2344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:10.272612 2344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:10.275543 2344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50b0c491b0f7410a903b8eddb1466ae2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34681 } }
I20260809 00:46:10.276013 2344 leader_election.cc:302] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50b0c491b0f7410a903b8eddb1466ae2; no voters:
I20260809 00:46:10.276593 2344 leader_election.cc:288] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:10.276752 2352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:10.277880 2352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [term 1 LEADER]: Becoming Leader. State: Replica: 50b0c491b0f7410a903b8eddb1466ae2, State: Running, Role: LEADER
I20260809 00:46:10.278380 2352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50b0c491b0f7410a903b8eddb1466ae2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34681 } }
I20260809 00:46:10.278662 2344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:10.280857 2354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50b0c491b0f7410a903b8eddb1466ae2. Latest consensus state: current_term: 1 leader_uuid: "50b0c491b0f7410a903b8eddb1466ae2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50b0c491b0f7410a903b8eddb1466ae2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34681 } } }
I20260809 00:46:10.281296 2353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50b0c491b0f7410a903b8eddb1466ae2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50b0c491b0f7410a903b8eddb1466ae2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34681 } } }
I20260809 00:46:10.281555 2353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:10.281551 2354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:10.283083 2365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:10.288209 2365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:10.297541 2365 catalog_manager.cc:1347] Generated new cluster ID: dace867106a74e6b9b7598abf5f43de8
I20260809 00:46:10.297699 2365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:10.307129 2365 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:10.308465 2365 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:10.314512 2365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50b0c491b0f7410a903b8eddb1466ae2: Generated new TSK 0
I20260809 00:46:10.315318 2365 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:46:10.377449 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34681
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:10.723240 2392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:10.723524 2392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:10.723661 2392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:10.730861 2392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:10.730969 2392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:10.731124 2392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:10.740774 2392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:10.742093 2392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:10.743397 2392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:10.755884 2403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:10.755968 2400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:10.756102 2399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:10.756819 2392 server_base.cc:1034] running on GCE node
I20260809 00:46:10.757419 2392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:10.758356 2392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:10.759550 2392 hybrid_clock.cc:648] HybridClock initialized: now 1786236370759506 us; error 37 us; skew 500 ppm
I20260809 00:46:10.759864 2392 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:10 dist-test-slave-t7g5 krb5kdc[2218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236370, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:10.763011 2392 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:46:10.764506 2392 webserver.cc:460] Webserver started at http://127.28.92.129:38175/ using document root <none> and password file <none>
I20260809 00:46:10.765177 2392 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:10.765295 2392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:10.765588 2392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:10.768422 2392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "e8d9f393977846b3a58650a9b27e8b8f"
format_stamp: "Formatted at 2026-08-09 00:46:10 on dist-test-slave-t7g5"
server_key: "d58333dce1dcaa853fbf29ce9c39d43a"
server_key_iv: "edcb40b92d288ceb9005c5e3206bfcc4"
server_key_version: "encryptionkey@0"
I20260809 00:46:10.769191 2392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "e8d9f393977846b3a58650a9b27e8b8f"
format_stamp: "Formatted at 2026-08-09 00:46:10 on dist-test-slave-t7g5"
server_key: "d58333dce1dcaa853fbf29ce9c39d43a"
server_key_iv: "edcb40b92d288ceb9005c5e3206bfcc4"
server_key_version: "encryptionkey@0"
I20260809 00:46:10.774313 2392 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 00:46:10.777774 2412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:10.779184 2392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:46:10.779347 2392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "e8d9f393977846b3a58650a9b27e8b8f"
format_stamp: "Formatted at 2026-08-09 00:46:10 on dist-test-slave-t7g5"
server_key: "d58333dce1dcaa853fbf29ce9c39d43a"
server_key_iv: "edcb40b92d288ceb9005c5e3206bfcc4"
server_key_version: "encryptionkey@0"
I20260809 00:46:10.779546 2392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:10.813126 2392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:10.817605 2392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:10.817910 2392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:10.818894 2392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:10.820232 2392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:10.820308 2392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:10.820432 2392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:10.820487 2392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:10.850279 2392 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:34157
I20260809 00:46:10.850329 2595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:34157 every 8 connection(s)
I20260809 00:46:10.851548 2392 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:10.861511 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 2392
I20260809 00:46:10.861733 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:10.862390 29042 external_mini_cluster.cc:1428] Setting key ffa919f6cbf680af159503e4b613fe10
Aug 09 00:46:10 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236370, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:10.871419 2599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:10.853974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:39815 (local address 127.28.92.190:34681)
0809 00:46:10.854404 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:10.854409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:10.855396 (+ 987us) server_negotiation.cc:407] Connection header received
0809 00:46:10.857221 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:10.857226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:10.857306 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:10.857400 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:10.859059 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:10.860120 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:10.861623 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:10.862129 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:10.862249 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:10.865965 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:10.865971 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:10.865974 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:10.866006 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:10.868390 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:10.869212 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:10.869216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:10.869218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:10.869331 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:10.869792 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:10.869795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:10.869797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:10.870057 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:10.870178 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:10.870996 (+ 818us) server_negotiation.cc:299] Negotiation successful
0809 00:46:10.871172 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":221,"threads_started":1}
I20260809 00:46:10.872574 2600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:10.854558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34681 (local address 127.28.92.129:39815)
0809 00:46:10.855233 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:10.855270 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:10.856944 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:10.857697 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:10.857708 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:10.858241 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:10.858842 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:10.858863 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:10.860258 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:10.860261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:10.861480 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:10.861493 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:10.862399 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:10.862409 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:10.862680 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:10.863316 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:10.863345 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:10.865735 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:10.868535 (+ 2800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:10.868546 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:10.868565 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:10.869112 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:10.869421 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:10.869426 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:10.869429 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:10.869703 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:10.870174 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:10.870181 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:10.870621 (+ 440us) client_negotiation.cc:769] Sending connection context
0809 00:46:10.870918 (+ 297us) client_negotiation.cc:240] Negotiation successful
0809 00:46:10.871471 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":274,"threads_started":1}
I20260809 00:46:10.874106 2596 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34681
I20260809 00:46:10.874396 2596 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:10.875113 2596 heartbeater.cc:511] Master 127.28.92.190:34681 requested a full tablet report, sending...
I20260809 00:46:10.877202 2290 ts_manager.cc:194] Registered new tserver with Master: e8d9f393977846b3a58650a9b27e8b8f (127.28.92.129:34157)
I20260809 00:46:10.878775 2290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:39815
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:46:10.908696 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34681
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:11.233348 2605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:11.233701 2605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:11.233845 2605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:11.241401 2605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:11.241540 2605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:11.241735 2605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:11.251747 2605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:11.253125 2605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:11.254541 2605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:11.269375 2613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:11.269474 2618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:11.269433 2614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:11.270903 2605 server_base.cc:1034] running on GCE node
I20260809 00:46:11.271572 2605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:11.272591 2605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:11.273802 2605 hybrid_clock.cc:648] HybridClock initialized: now 1786236371273718 us; error 77 us; skew 500 ppm
I20260809 00:46:11.274116 2605 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:11.277527 2605 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:46:11.279408 2605 webserver.cc:460] Webserver started at http://127.28.92.130:41461/ using document root <none> and password file <none>
I20260809 00:46:11.280301 2605 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:11.280452 2605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:11.280797 2605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:11.285120 2605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "97516ed43aa34d48b7076b7606b75b93"
format_stamp: "Formatted at 2026-08-09 00:46:11 on dist-test-slave-t7g5"
server_key: "e4bbee0eebf7039bfbd1cbf808f775f2"
server_key_iv: "8088ab37b7a2ccdb69d1ecd5a4dfc074"
server_key_version: "encryptionkey@0"
I20260809 00:46:11.286269 2605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "97516ed43aa34d48b7076b7606b75b93"
format_stamp: "Formatted at 2026-08-09 00:46:11 on dist-test-slave-t7g5"
server_key: "e4bbee0eebf7039bfbd1cbf808f775f2"
server_key_iv: "8088ab37b7a2ccdb69d1ecd5a4dfc074"
server_key_version: "encryptionkey@0"
I20260809 00:46:11.293335 2605 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260809 00:46:11.297995 2628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:11.299693 2605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:46:11.299886 2605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "97516ed43aa34d48b7076b7606b75b93"
format_stamp: "Formatted at 2026-08-09 00:46:11 on dist-test-slave-t7g5"
server_key: "e4bbee0eebf7039bfbd1cbf808f775f2"
server_key_iv: "8088ab37b7a2ccdb69d1ecd5a4dfc074"
server_key_version: "encryptionkey@0"
I20260809 00:46:11.300150 2605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:11.321470 2605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:11.326845 2605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:11.327185 2605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:11.328406 2605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:11.330224 2605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:11.330330 2605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:11.330469 2605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:11.330539 2605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:11.365216 2605 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:46783
I20260809 00:46:11.365259 2812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:46783 every 8 connection(s)
I20260809 00:46:11.366992 2605 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:11.368757 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 2605
I20260809 00:46:11.368960 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:11.369498 29042 external_mini_cluster.cc:1428] Setting key ce91c424c1dd29b1d1fbe1d222dd5fd8
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:11.392498 2599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.370032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:51109 (local address 127.28.92.190:34681)
0809 00:46:11.370422 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:11.370428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:11.372185 (+ 1757us) server_negotiation.cc:407] Connection header received
0809 00:46:11.374773 (+ 2588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:11.374779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:11.374874 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:11.374990 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:11.377022 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.378223 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.380307 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.380740 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.380855 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.385214 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:11.385221 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:11.385226 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:11.385270 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:11.388763 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.389722 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.389728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.389732 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.389905 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.390410 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.390415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.390419 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.390787 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:11.390934 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:11.391865 (+ 931us) server_negotiation.cc:299] Negotiation successful
0809 00:46:11.392119 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257}
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
I20260809 00:46:11.393726 2817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.370792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34681 (local address 127.28.92.130:51109)
0809 00:46:11.372012 (+ 1220us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:11.372064 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:11.374438 (+ 2374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:11.375260 (+ 822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:11.375271 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:11.376014 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:11.376794 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:11.376818 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.378400 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.378406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:11.380167 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:11.380180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.380960 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.380967 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:11.381195 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.381891 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:11.381924 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:11.384935 (+ 3011us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:11.388937 (+ 4002us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:11.388954 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:11.388971 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:11.389564 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:11.390026 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:11.390031 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:11.390035 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:11.390295 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:11.390943 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:11.390962 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:11.391423 (+ 461us) client_negotiation.cc:769] Sending connection context
0809 00:46:11.391753 (+ 330us) client_negotiation.cc:240] Negotiation successful
0809 00:46:11.392338 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"thread_start_us":649,"threads_started":1}
I20260809 00:46:11.395350 2814 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
I20260809 00:46:11.395700 2814 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:11.396500 2814 heartbeater.cc:511] Master 127.28.92.190:34681 requested a full tablet report, sending...
I20260809 00:46:11.397989 2290 ts_manager.cc:194] Registered new tserver with Master: 97516ed43aa34d48b7076b7606b75b93 (127.28.92.130:46783)
I20260809 00:46:11.398794 2290 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:51109
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:46:11.422454 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34681
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:11.741271 2822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:11.741578 2822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:11.741748 2822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:11.748978 2822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:11.749119 2822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:11.749279 2822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:11.759239 2822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:11.760576 2822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:11.762012 2822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:11.775030 2827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:11.775007 2828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:11.774979 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:11.775825 2822 server_base.cc:1034] running on GCE node
I20260809 00:46:11.776448 2822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:11.777386 2822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:11.778578 2822 hybrid_clock.cc:648] HybridClock initialized: now 1786236371778513 us; error 55 us; skew 500 ppm
I20260809 00:46:11.778867 2822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:11.781980 2822 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:46:11.783470 2822 webserver.cc:460] Webserver started at http://127.28.92.131:33235/ using document root <none> and password file <none>
I20260809 00:46:11.784224 2822 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:11.784353 2822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:11.784657 2822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:11.787616 2822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "9b71b42fedd54db68aacb008654a94d1"
format_stamp: "Formatted at 2026-08-09 00:46:11 on dist-test-slave-t7g5"
server_key: "e15b602330e5f380676318ba86f3c020"
server_key_iv: "afa9bd6d8391cd382b37bcf947863f2d"
server_key_version: "encryptionkey@0"
I20260809 00:46:11.788386 2822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "9b71b42fedd54db68aacb008654a94d1"
format_stamp: "Formatted at 2026-08-09 00:46:11 on dist-test-slave-t7g5"
server_key: "e15b602330e5f380676318ba86f3c020"
server_key_iv: "afa9bd6d8391cd382b37bcf947863f2d"
server_key_version: "encryptionkey@0"
I20260809 00:46:11.793530 2822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:46:11.796993 2842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:11.798432 2822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:11.798614 2822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "9b71b42fedd54db68aacb008654a94d1"
format_stamp: "Formatted at 2026-08-09 00:46:11 on dist-test-slave-t7g5"
server_key: "e15b602330e5f380676318ba86f3c020"
server_key_iv: "afa9bd6d8391cd382b37bcf947863f2d"
server_key_version: "encryptionkey@0"
I20260809 00:46:11.798849 2822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:11.817202 2822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:11.821192 2822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:11.821430 2822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:11.822389 2822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:11.823660 2822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:11.823734 2822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:11.823830 2822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:11.823887 2822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:11.853960 2822 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:44861
I20260809 00:46:11.853966 3027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:44861 every 8 connection(s)
I20260809 00:46:11.855552 2822 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:11.861675 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 2822
I20260809 00:46:11.861876 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:11.862424 29042 external_mini_cluster.cc:1428] Setting key cb714a091acfd9aa4d493290acd9ea0a
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:11.874480 2599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.858178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:48379 (local address 127.28.92.190:34681)
0809 00:46:11.858383 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:11.858389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:11.859473 (+ 1084us) server_negotiation.cc:407] Connection header received
0809 00:46:11.861181 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:11.861185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:11.861281 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:11.861366 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:11.863358 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.864172 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.865719 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.866155 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.866265 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.869517 (+ 3252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:11.869522 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:11.869525 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:11.869558 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:11.871825 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.872485 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.872489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.872491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.872611 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.872955 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.872957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.872959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.873223 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:11.873330 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:11.874061 (+ 731us) server_negotiation.cc:299] Negotiation successful
0809 00:46:11.874234 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:46:11.875464 3032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.858633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34681 (local address 127.28.92.131:48379)
0809 00:46:11.859313 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:11.859351 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:11.860943 (+ 1592us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:11.861670 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:11.861682 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:11.862410 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:11.863164 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:11.863185 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.864321 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.864326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:11.865555 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:11.865568 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.866377 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.866385 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:11.866616 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.867199 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:11.867224 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:11.869327 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:11.871959 (+ 2632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:11.871966 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:11.871980 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:11.872399 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:11.872686 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:11.872689 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:11.872692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:11.872872 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:11.873309 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:11.873315 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:11.873680 (+ 365us) client_negotiation.cc:769] Sending connection context
0809 00:46:11.873968 (+ 288us) client_negotiation.cc:240] Negotiation successful
0809 00:46:11.874366 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":260,"threads_started":1}
I20260809 00:46:11.877053 3029 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34681
I20260809 00:46:11.877378 3029 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:11.878188 3029 heartbeater.cc:511] Master 127.28.92.190:34681 requested a full tablet report, sending...
I20260809 00:46:11.879645 2289 ts_manager.cc:194] Registered new tserver with Master: 9b71b42fedd54db68aacb008654a94d1 (127.28.92.131:44861)
I20260809 00:46:11.880592 2289 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:48379
I20260809 00:46:11.881616 2596 heartbeater.cc:503] Master 127.28.92.190:34681 was elected leader, sending a full tablet report...
I20260809 00:46:11.889976 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:11.940411 3041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.926415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59890 (local address 127.28.92.129:34157)
0809 00:46:11.927063 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:11.927071 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:11.927104 (+ 33us) server_negotiation.cc:407] Connection header received
0809 00:46:11.927169 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:11.927176 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:11.927392 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:11.927524 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:11.928892 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.929911 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.931059 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.931608 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.931698 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.935377 (+ 3679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:11.935394 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:11.935414 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:11.935458 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:11.938055 (+ 2597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.938658 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.938665 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.938668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.938794 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.939070 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.939073 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.939075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.939414 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:11.939647 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:11.939847 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 00:46:11.940059 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":352,"threads_started":1}
Aug 09 00:46:11 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:11.956897 2599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.944619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45106 (local address 127.28.92.190:34681)
0809 00:46:11.944830 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:11.944836 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:11.944989 (+ 153us) server_negotiation.cc:407] Connection header received
0809 00:46:11.945112 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:11.945116 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:11.945178 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:11.945253 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:11.946450 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.947167 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.948337 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.948746 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.948834 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.952424 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:11.952431 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:11.952436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:11.952479 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:11.954815 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.955373 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.955377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.955379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.955510 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.955784 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.955787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.955789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.956122 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:11.956306 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:11.956511 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 00:46:11.956672 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 00:46:11.957474 2289 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45106
I20260809 00:46:11.958429 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 2392
I20260809 00:46:11.970054 3041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:11.959299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59892 (local address 127.28.92.129:34157)
0809 00:46:11.959503 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:11.959509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:11.959641 (+ 132us) server_negotiation.cc:407] Connection header received
0809 00:46:11.959757 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:11.959761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:11.959835 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:11.959908 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:11.960969 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.961608 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.962826 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:11.963226 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:11.963314 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:11.965352 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:11.965357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:11.965360 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:11.965389 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:11.967767 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.968346 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.968349 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.968351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.968473 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:11.968742 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:11.968744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:11.968746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:11.969072 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:11.969309 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:11.969486 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 00:46:11.969735 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 00:46:11.970642 2588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:12.051391 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 2392
I20260809 00:46:12.073536 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 2605
Aug 09 00:46:12 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:46:12.088636 3047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:12.074432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39880 (local address 127.28.92.130:46783)
0809 00:46:12.074951 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:12.074960 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:12.074987 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:46:12.075050 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:12.075056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:12.075275 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:12.075408 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:12.076508 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:12.077508 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:12.078722 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:12.079361 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:12.079469 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:12.083495 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:12.083509 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:12.083525 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:12.083559 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:12.086392 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:12.086947 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:12.086954 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:12.086956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:12.087078 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:12.087358 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:12.087360 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:12.087362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:12.087695 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:12.087920 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:12.088143 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 00:46:12.088336 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":261,"threads_started":1}
I20260809 00:46:12.089990 2805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:12.170598 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 2605
I20260809 00:46:12.195283 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 2822
Aug 09 00:46:12 dist-test-slave-t7g5 krb5kdc[2218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:46:12.211812 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:12.196608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.28.92.131:44861)
0809 00:46:12.197404 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:12.197414 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:12.197461 (+ 47us) server_negotiation.cc:407] Connection header received
0809 00:46:12.197545 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:12.197556 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:12.197873 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:12.198138 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:12.199291 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:12.200318 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:12.201503 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:12.202238 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:12.202328 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:12.206566 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:12.206577 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:12.206592 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:12.206625 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:12.209321 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:12.210055 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:12.210062 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:12.210065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:12.210196 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:12.210464 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:12.210467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:12.210469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:12.210809 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:12.211041 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:12.211258 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 00:46:12.211466 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":410,"threads_started":1}
I20260809 00:46:12.213105 3022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:12.295810 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 2822
I20260809 00:46:12.315897 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 2238
I20260809 00:46:12.317070 2334 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:12.419305 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 2238
2026-08-09T00:46:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4026 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:12 dist-test-slave-t7g5 krb5kdc[3064](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:12 dist-test-slave-t7g5 krb5kdc[3064](info): set up 2 sockets
Aug 09 00:46:12 dist-test-slave-t7g5 krb5kdc[3064](info): commencing operation
krb5kdc: starting...
W20260809 00:46:13.616958 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.005s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:13 dist-test-slave-t7g5 krb5kdc[3064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:13.825017 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41669
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:41669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:14.144378 3088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:14.144652 3088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:14.144784 3088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:14.151731 3088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:14.151831 3088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:14.151906 3088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:14.151981 3088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:14.152048 3088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:14.161394 3088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:41669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:14.162581 3088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:14.163805 3088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:14.174659 3098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:14.174614 3097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:14.175108 3102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:14.175397 3088 server_base.cc:1034] running on GCE node
I20260809 00:46:14.176144 3088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:14.177357 3088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:14.178552 3088 hybrid_clock.cc:648] HybridClock initialized: now 1786236374178512 us; error 30 us; skew 500 ppm
I20260809 00:46:14.178900 3088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:14 dist-test-slave-t7g5 krb5kdc[3064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236374, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:14.181867 3088 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:14.182969 3088 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:14.183073 3088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:14.183380 3088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:14.186250 3088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "c8053dd8f11a433a92e8ec885e9e55b9"
format_stamp: "Formatted at 2026-08-09 00:46:14 on dist-test-slave-t7g5"
server_key: "c94eba36b9bc8eeb4f6835304be9837e"
server_key_iv: "4baead6adbdf578271b78efc7866b70f"
server_key_version: "encryptionkey@0"
I20260809 00:46:14.187002 3088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "c8053dd8f11a433a92e8ec885e9e55b9"
format_stamp: "Formatted at 2026-08-09 00:46:14 on dist-test-slave-t7g5"
server_key: "c94eba36b9bc8eeb4f6835304be9837e"
server_key_iv: "4baead6adbdf578271b78efc7866b70f"
server_key_version: "encryptionkey@0"
I20260809 00:46:14.193084 3088 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260809 00:46:14.196798 3109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:14.198114 3088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:14.198271 3088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "c8053dd8f11a433a92e8ec885e9e55b9"
format_stamp: "Formatted at 2026-08-09 00:46:14 on dist-test-slave-t7g5"
server_key: "c94eba36b9bc8eeb4f6835304be9837e"
server_key_iv: "4baead6adbdf578271b78efc7866b70f"
server_key_version: "encryptionkey@0"
I20260809 00:46:14.198469 3088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:14.211513 3088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:14.215730 3088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:14.215965 3088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:14.232831 3088 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:41669
I20260809 00:46:14.232800 3198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:41669 every 8 connection(s)
I20260809 00:46:14.233732 3088 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:14.234738 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 3088
I20260809 00:46:14.234975 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:14.235795 29042 external_mini_cluster.cc:1428] Setting key e364901c9396a4c165421f1a61c3a954
I20260809 00:46:14.238142 3199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 00:46:14 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:14.251151 3199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9: Bootstrap starting.
I20260809 00:46:14.254587 3199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:14.255622 3199 log.cc:824] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:14.258656 3199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9: No bootstrap required, opened a new log
I20260809 00:46:14.258687 3202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:14.238022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58214 (local address 127.28.92.190:41669)
0809 00:46:14.238836 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:14.238848 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:14.238888 (+ 40us) server_negotiation.cc:407] Connection header received
0809 00:46:14.240460 (+ 1572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:14.240481 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:14.240854 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:14.241167 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:14.243002 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:14.244286 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:14.246013 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:14.246657 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:14.246789 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:14.251549 (+ 4760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:14.251558 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:14.251572 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:14.251618 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:14.254589 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:14.255288 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:14.255295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:14.255301 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:14.255505 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:14.255883 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:14.255886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:14.255889 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:14.256637 (+ 748us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:14.256947 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:14.257315 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 00:46:14.257724 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":390,"threads_started":1}
I20260809 00:46:14.266216 3199 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41669 } }
I20260809 00:46:14.266600 3199 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:14.266691 3199 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8053dd8f11a433a92e8ec885e9e55b9, State: Initialized, Role: FOLLOWER
I20260809 00:46:14.267243 3199 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41669 } }
I20260809 00:46:14.267515 3199 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:14.267666 3199 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:14.267838 3199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:14.270056 3199 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41669 } }
I20260809 00:46:14.270555 3199 leader_election.cc:302] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8053dd8f11a433a92e8ec885e9e55b9; no voters:
I20260809 00:46:14.271070 3199 leader_election.cc:288] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:14.271191 3204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:14.271824 3204 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [term 1 LEADER]: Becoming Leader. State: Replica: c8053dd8f11a433a92e8ec885e9e55b9, State: Running, Role: LEADER
I20260809 00:46:14.272360 3204 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41669 } }
I20260809 00:46:14.273018 3199 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:14.275399 3207 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8053dd8f11a433a92e8ec885e9e55b9. Latest consensus state: current_term: 1 leader_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41669 } } }
I20260809 00:46:14.275770 3207 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:14.278961 3211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:14.279032 3205 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8053dd8f11a433a92e8ec885e9e55b9" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41669 } } }
I20260809 00:46:14.279326 3205 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:14.284750 3211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:14.293234 3211 catalog_manager.cc:1347] Generated new cluster ID: 6353358f751d4163a3df7096f2cf6f34
I20260809 00:46:14.293366 3211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:14.311177 3211 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:14.313133 3211 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:14.324065 3211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9: Generated new TSK 0
I20260809 00:46:14.325140 3211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:46:14.374756 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41669
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:14.693773 3234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:14.694023 3234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:14.694126 3234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:14.701009 3234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:14.701108 3234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:14.701225 3234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:14.710642 3234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41669
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:14.711839 3234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:14.713111 3234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:14.725468 3241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:14.725405 3243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:14.725430 3239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:14.726634 3234 server_base.cc:1034] running on GCE node
I20260809 00:46:14.727191 3234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:14.728052 3234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:14.729235 3234 hybrid_clock.cc:648] HybridClock initialized: now 1786236374729178 us; error 48 us; skew 500 ppm
I20260809 00:46:14.729534 3234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:14 dist-test-slave-t7g5 krb5kdc[3064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236374, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:14.732635 3234 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:46:14.733771 3234 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:14.733866 3234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:14.734134 3234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:14.736975 3234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "e6d7e499400e4751bf18cd35726f2ec4"
format_stamp: "Formatted at 2026-08-09 00:46:14 on dist-test-slave-t7g5"
server_key: "806165cd577ff575ffce8e538f8bb697"
server_key_iv: "aca46c20d462d883d33a394d89c32045"
server_key_version: "encryptionkey@0"
I20260809 00:46:14.737793 3234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "e6d7e499400e4751bf18cd35726f2ec4"
format_stamp: "Formatted at 2026-08-09 00:46:14 on dist-test-slave-t7g5"
server_key: "806165cd577ff575ffce8e538f8bb697"
server_key_iv: "aca46c20d462d883d33a394d89c32045"
server_key_version: "encryptionkey@0"
I20260809 00:46:14.742707 3234 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:46:14.746104 3256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:14.747437 3234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 00:46:14.747593 3234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "e6d7e499400e4751bf18cd35726f2ec4"
format_stamp: "Formatted at 2026-08-09 00:46:14 on dist-test-slave-t7g5"
server_key: "806165cd577ff575ffce8e538f8bb697"
server_key_iv: "aca46c20d462d883d33a394d89c32045"
server_key_version: "encryptionkey@0"
I20260809 00:46:14.747807 3234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:14.768203 3234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:14.772444 3234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:14.772703 3234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:14.773739 3234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:14.775175 3234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:14.775269 3234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:14.775354 3234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:14.775408 3234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:14.805447 3234 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:37129
I20260809 00:46:14.805490 3445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:37129 every 8 connection(s)
I20260809 00:46:14.806360 3234 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:14.814903 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 3234
I20260809 00:46:14.815138 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:14.815989 29042 external_mini_cluster.cc:1428] Setting key aa4b4fe77d55df5fd5e4a479a5a19cbd
Aug 09 00:46:14 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236374, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:14.827601 3448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:14.809121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:56331 (local address 127.28.92.190:41669)
0809 00:46:14.809601 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:14.809609 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:14.810653 (+ 1044us) server_negotiation.cc:407] Connection header received
0809 00:46:14.812394 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:14.812399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:14.812474 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:14.812587 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:14.814092 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:14.814863 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:14.817045 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:14.817489 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:14.817588 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:14.821630 (+ 4042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:14.821636 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:14.821639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:14.821701 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:14.824390 (+ 2689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:14.825225 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:14.825229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:14.825231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:14.825347 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:14.825813 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:14.825816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:14.825819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:14.826099 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:14.826246 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:14.826988 (+ 742us) server_negotiation.cc:299] Negotiation successful
0809 00:46:14.827238 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":207,"threads_started":1}
I20260809 00:46:14.828573 3450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:14.809763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41669 (local address 127.28.92.129:56331)
0809 00:46:14.810485 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:14.810531 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:14.812133 (+ 1602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:14.812766 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:14.812774 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:14.813303 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:14.813919 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:14.813939 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:14.815049 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:14.815055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:14.816888 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:14.816905 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:14.817746 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:14.817754 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:14.817986 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:14.818679 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:14.818711 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:14.821381 (+ 2670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:14.824537 (+ 3156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:14.824547 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:14.824564 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:14.825122 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:14.825436 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:14.825441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:14.825444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:14.825716 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:14.826236 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:14.826242 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:14.826576 (+ 334us) client_negotiation.cc:769] Sending connection context
0809 00:46:14.826823 (+ 247us) client_negotiation.cc:240] Negotiation successful
0809 00:46:14.827374 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":289,"threads_started":1}
I20260809 00:46:14.830196 3446 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41669
I20260809 00:46:14.830490 3446 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:14.831141 3446 heartbeater.cc:511] Master 127.28.92.190:41669 requested a full tablet report, sending...
I20260809 00:46:14.833150 3138 ts_manager.cc:194] Registered new tserver with Master: e6d7e499400e4751bf18cd35726f2ec4 (127.28.92.129:37129)
I20260809 00:46:14.834733 3138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:56331
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:46:14.862922 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41669
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:15.186043 3453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:15.186354 3453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:15.186494 3453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:15.193771 3453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:15.193918 3453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:15.194080 3453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:15.204017 3453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41669
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:15.205375 3453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:15.206744 3453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:15.219434 3461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:15.219504 3466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:15.219484 3459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:15.220292 3453 server_base.cc:1034] running on GCE node
I20260809 00:46:15.220901 3453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:15.221863 3453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:15.223061 3453 hybrid_clock.cc:648] HybridClock initialized: now 1786236375223017 us; error 33 us; skew 500 ppm
I20260809 00:46:15.223385 3453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:15 dist-test-slave-t7g5 krb5kdc[3064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236375, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:15.229278 3453 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:46:15.230564 3453 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:15.230667 3453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:15.231009 3453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:15.234076 3453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "78d15b9dd63640e3a24ec9269069e8ba"
format_stamp: "Formatted at 2026-08-09 00:46:15 on dist-test-slave-t7g5"
server_key: "2b4b4364231698becd881311a028a698"
server_key_iv: "6f64cd841b48fd4a68bd71d6558bc1d1"
server_key_version: "encryptionkey@0"
I20260809 00:46:15.234859 3453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "78d15b9dd63640e3a24ec9269069e8ba"
format_stamp: "Formatted at 2026-08-09 00:46:15 on dist-test-slave-t7g5"
server_key: "2b4b4364231698becd881311a028a698"
server_key_iv: "6f64cd841b48fd4a68bd71d6558bc1d1"
server_key_version: "encryptionkey@0"
I20260809 00:46:15.239761 3453 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 00:46:15.243209 3474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:15.244539 3453 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:15.244699 3453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "78d15b9dd63640e3a24ec9269069e8ba"
format_stamp: "Formatted at 2026-08-09 00:46:15 on dist-test-slave-t7g5"
server_key: "2b4b4364231698becd881311a028a698"
server_key_iv: "6f64cd841b48fd4a68bd71d6558bc1d1"
server_key_version: "encryptionkey@0"
I20260809 00:46:15.244913 3453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:15.268543 3453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:15.272570 3453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:15.272848 3453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:15.273919 3453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:15.275313 3453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:15.275413 3453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:15.275543 3453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:15.275616 3453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:15.307463 3453 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:34305
I20260809 00:46:15.307525 3657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:34305 every 8 connection(s)
I20260809 00:46:15.308398 3453 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:15.312633 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 3453
I20260809 00:46:15.312831 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:15.313382 29042 external_mini_cluster.cc:1428] Setting key 0161694e093cb294e7a2393b8a028cb2
Aug 09 00:46:15 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236375, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:15.332358 3448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.310871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:46465 (local address 127.28.92.190:41669)
0809 00:46:15.311093 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:15.311100 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:15.312177 (+ 1077us) server_negotiation.cc:407] Connection header received
0809 00:46:15.314535 (+ 2358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:15.314539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:15.314613 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:15.314695 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:15.316650 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.317360 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.321377 (+ 4017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.322061 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.322194 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.326574 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:15.326581 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:15.326586 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:15.326623 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:15.329249 (+ 2626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:15.330073 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:15.330078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:15.330081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:15.330224 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:15.330644 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:15.330649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:15.330651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:15.330924 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:15.331060 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:15.331798 (+ 738us) server_negotiation.cc:299] Negotiation successful
0809 00:46:15.332031 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 00:46:15.333695 3664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.311288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41669 (local address 127.28.92.130:46465)
0809 00:46:15.312012 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:15.312053 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:15.314276 (+ 2223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:15.314981 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:15.314993 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:15.315651 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:15.316453 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.316482 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.317526 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.317531 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.319303 (+ 1772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.319317 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.322425 (+ 3108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.322435 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.322723 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.323516 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:15.323550 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:15.326326 (+ 2776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:15.329383 (+ 3057us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:15.329394 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:15.329412 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:15.329938 (+ 526us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:15.330331 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:15.330336 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:15.330340 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:15.330526 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:15.331050 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:15.331058 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:15.331400 (+ 342us) client_negotiation.cc:769] Sending connection context
0809 00:46:15.331656 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 00:46:15.332215 (+ 559us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":287,"threads_started":1}
I20260809 00:46:15.335326 3660 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41669
I20260809 00:46:15.335652 3660 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:15.336287 3660 heartbeater.cc:511] Master 127.28.92.190:41669 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
I20260809 00:46:15.337863 3138 ts_manager.cc:194] Registered new tserver with Master: 78d15b9dd63640e3a24ec9269069e8ba (127.28.92.130:34305)
I20260809 00:46:15.338732 3138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:46465
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:46:15.362965 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41669
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:15.677486 3670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:15.677835 3670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:15.677974 3670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:15.685158 3670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:15.685277 3670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:15.685436 3670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:15.695258 3670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41669
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:15.696641 3670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:15.698004 3670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:15.710505 3681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:15.710712 3680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:15.710548 3683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:15.711531 3670 server_base.cc:1034] running on GCE node
I20260809 00:46:15.712139 3670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:15.713021 3670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:15.714222 3670 hybrid_clock.cc:648] HybridClock initialized: now 1786236375714175 us; error 33 us; skew 500 ppm
I20260809 00:46:15.714542 3670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:15 dist-test-slave-t7g5 krb5kdc[3064](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236375, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:15.717499 3670 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:46:15.718680 3670 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:15.718787 3670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:15.719081 3670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:15.722005 3670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "95846209e0b2437faace3030c3d03849"
format_stamp: "Formatted at 2026-08-09 00:46:15 on dist-test-slave-t7g5"
server_key: "67cc1f87497adabc4d7f79210cbdd344"
server_key_iv: "c30e090e749caf1b70e6d11d7f8c1c24"
server_key_version: "encryptionkey@0"
I20260809 00:46:15.722870 3670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "95846209e0b2437faace3030c3d03849"
format_stamp: "Formatted at 2026-08-09 00:46:15 on dist-test-slave-t7g5"
server_key: "67cc1f87497adabc4d7f79210cbdd344"
server_key_iv: "c30e090e749caf1b70e6d11d7f8c1c24"
server_key_version: "encryptionkey@0"
I20260809 00:46:15.727881 3670 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:15.731251 3695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:15.732478 3670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:15.732638 3670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "95846209e0b2437faace3030c3d03849"
format_stamp: "Formatted at 2026-08-09 00:46:15 on dist-test-slave-t7g5"
server_key: "67cc1f87497adabc4d7f79210cbdd344"
server_key_iv: "c30e090e749caf1b70e6d11d7f8c1c24"
server_key_version: "encryptionkey@0"
I20260809 00:46:15.732838 3670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:15.789408 3670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:15.793278 3670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:15.793550 3670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:15.794541 3670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:15.795831 3670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:15.795928 3670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:15.796031 3670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:15.796100 3670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:15.828328 3670 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:45273
I20260809 00:46:15.828388 3880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:45273 every 8 connection(s)
I20260809 00:46:15.829144 3670 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:15.830343 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 3670
I20260809 00:46:15.830539 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:15.830968 29042 external_mini_cluster.cc:1428] Setting key 4de635ad6350f0966755530b2697f96e
I20260809 00:46:15.837543 3446 heartbeater.cc:503] Master 127.28.92.190:41669 was elected leader, sending a full tablet report...
Aug 09 00:46:15 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236375, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:15.848215 3448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.831704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:45587 (local address 127.28.92.190:41669)
0809 00:46:15.831915 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:15.831921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:15.833173 (+ 1252us) server_negotiation.cc:407] Connection header received
0809 00:46:15.835220 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:15.835223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:15.835299 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:15.835378 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:15.836893 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.837647 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.839509 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.839940 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.840036 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.843100 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:15.843105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:15.843108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:15.843139 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:15.845545 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:15.846272 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:15.846277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:15.846281 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:15.846424 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:15.846784 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:15.846787 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:15.846789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:15.847067 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:15.847177 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:15.847790 (+ 613us) server_negotiation.cc:299] Negotiation successful
0809 00:46:15.847960 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 00:46:15.849116 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.832217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41669 (local address 127.28.92.131:45587)
0809 00:46:15.833040 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:15.833078 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:15.834991 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:15.835602 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:15.835609 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:15.836118 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:15.836746 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.836766 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.837818 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.837823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.839384 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.839396 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.840103 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.840108 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.840285 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.840830 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:15.840851 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:15.842920 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:15.845697 (+ 2777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:15.845705 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:15.845716 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:15.846161 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:15.846512 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:15.846515 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:15.846517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:15.846702 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:15.847157 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:15.847162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:15.847462 (+ 300us) client_negotiation.cc:769] Sending connection context
0809 00:46:15.847706 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 00:46:15.848061 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":342,"threads_started":1}
I20260809 00:46:15.850375 3885 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41669
I20260809 00:46:15.850672 3885 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:15.851270 3885 heartbeater.cc:511] Master 127.28.92.190:41669 requested a full tablet report, sending...
I20260809 00:46:15.852581 3138 ts_manager.cc:194] Registered new tserver with Master: 95846209e0b2437faace3030c3d03849 (127.28.92.131:45273)
I20260809 00:46:15.853315 3138 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:45587
I20260809 00:46:15.858145 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:46:15.874003 3448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.862440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58218 (local address 127.28.92.190:41669)
0809 00:46:15.862592 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:15.862597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:15.863079 (+ 482us) server_negotiation.cc:407] Connection header received
0809 00:46:15.863232 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:15.863237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:15.863304 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:15.863380 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:15.864751 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.865460 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.866738 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.867157 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.867276 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.869336 (+ 2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:15.869342 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:15.869348 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:15.869382 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:15.871797 (+ 2415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:15.872330 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:15.872333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:15.872336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:15.872452 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:15.872714 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:15.872717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:15.872719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:15.873023 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:15.873199 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:15.873485 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 00:46:15.873688 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:46:15.877540 3138 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:15.884271 3138 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:15.921200 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.895209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45273 (local address 127.0.0.1:43586)
0809 00:46:15.911871 (+ 16662us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:15.911897 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:15.912202 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:15.913239 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:15.913248 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:15.913277 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:15.913731 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.913747 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.915635 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.915640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.917955 (+ 2315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.917969 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.920019 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.920026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.920233 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.920293 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 00:46:15.920422 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 00:46:15.920646 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16554,"mutex_wait_us":199,"thread_start_us":16422,"threads_started":1}
I20260809 00:46:15.921290 3915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.895766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43586 (local address 127.28.92.131:45273)
0809 00:46:15.911464 (+ 15698us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:15.911474 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:15.912124 (+ 650us) server_negotiation.cc:407] Connection header received
0809 00:46:15.912421 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:15.912429 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:15.912701 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:15.912888 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:15.914005 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.915427 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.918096 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.919513 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.919642 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.919884 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:15.920785 (+ 901us) server_negotiation.cc:299] Negotiation successful
0809 00:46:15.920955 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15523,"thread_start_us":15373,"threads_started":1}
I20260809 00:46:15.921782 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.895358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39952 (local address 127.28.92.129:37129)
0809 00:46:15.914148 (+ 18790us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:15.914156 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:15.914184 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:46:15.914275 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:15.914282 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:15.914515 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:15.914698 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:15.915248 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.916770 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.919008 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.920304 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.920427 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.920635 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:15.921259 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 00:46:15.921432 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18607,"thread_start_us":18449,"threads_started":1}
I20260809 00:46:15.922179 3916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.896240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43106 (local address 127.28.92.130:34305)
0809 00:46:15.912209 (+ 15969us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:15.912217 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:15.912927 (+ 710us) server_negotiation.cc:407] Connection header received
0809 00:46:15.913038 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:15.913045 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:15.913269 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:15.913443 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:15.914217 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.915496 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.918433 (+ 2937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.919803 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.919932 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.920142 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:15.921321 (+ 1179us) server_negotiation.cc:299] Negotiation successful
0809 00:46:15.921489 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15793,"thread_start_us":15698,"threads_started":1}
I20260809 00:46:15.921829 3909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.895016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:39952)
0809 00:46:15.910706 (+ 15690us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:15.910757 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:15.910935 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:15.914711 (+ 3776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:15.914716 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:15.914741 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:15.915074 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.915087 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.916913 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.916918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.918857 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.918868 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.920530 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.920537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.920699 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.920748 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 00:46:15.920853 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 00:46:15.920985 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15409,"mutex_wait_us":57,"thread_start_us":15277,"threads_started":1}
I20260809 00:46:15.921156 3914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:15.895668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34305 (local address 127.0.0.1:43106)
0809 00:46:15.912631 (+ 16963us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:15.912656 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:15.912769 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:15.913597 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:15.913602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:15.913637 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:15.914076 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.914087 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.915651 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.915656 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.918272 (+ 2616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:15.918287 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:15.920284 (+ 1997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:15.920291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:15.920438 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:15.920472 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 00:46:15.920543 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 00:46:15.920655 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16831,"mutex_wait_us":149,"thread_start_us":16679,"threads_started":1}
I20260809 00:46:15.925387 3778 tablet_service.cc:1467] Processing CreateTablet for tablet 286d3fe683ff48cb8004f42e47664c90 (DEFAULT_TABLE table=test-table [id=60e34db8a8c94449a131cdfffa77778a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:15.925607 3555 tablet_service.cc:1467] Processing CreateTablet for tablet 286d3fe683ff48cb8004f42e47664c90 (DEFAULT_TABLE table=test-table [id=60e34db8a8c94449a131cdfffa77778a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:15.926643 3778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 286d3fe683ff48cb8004f42e47664c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:15.926887 3555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 286d3fe683ff48cb8004f42e47664c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:15.928544 3339 tablet_service.cc:1467] Processing CreateTablet for tablet 286d3fe683ff48cb8004f42e47664c90 (DEFAULT_TABLE table=test-table [id=60e34db8a8c94449a131cdfffa77778a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:15.929924 3339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 286d3fe683ff48cb8004f42e47664c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:15.937783 3919 tablet_bootstrap.cc:492] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Bootstrap starting.
I20260809 00:46:15.940801 3920 tablet_bootstrap.cc:492] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Bootstrap starting.
I20260809 00:46:15.941262 3919 tablet_bootstrap.cc:654] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:15.942850 3919 log.cc:824] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:15.943325 3922 tablet_bootstrap.cc:492] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Bootstrap starting.
I20260809 00:46:15.944270 3920 tablet_bootstrap.cc:654] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:15.945303 3920 log.cc:824] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:15.946489 3922 tablet_bootstrap.cc:654] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:15.946605 3919 tablet_bootstrap.cc:492] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: No bootstrap required, opened a new log
I20260809 00:46:15.946888 3919 ts_tablet_manager.cc:1397] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260809 00:46:15.947484 3922 log.cc:824] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:15.948225 3920 tablet_bootstrap.cc:492] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: No bootstrap required, opened a new log
I20260809 00:46:15.948499 3920 ts_tablet_manager.cc:1397] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 00:46:15.950009 3922 tablet_bootstrap.cc:492] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: No bootstrap required, opened a new log
I20260809 00:46:15.950233 3922 ts_tablet_manager.cc:1397] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.005s
I20260809 00:46:15.957576 3922 raft_consensus.cc:348] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:15.957985 3922 raft_consensus.cc:374] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:15.958117 3922 raft_consensus.cc:729] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6d7e499400e4751bf18cd35726f2ec4, State: Initialized, Role: FOLLOWER
I20260809 00:46:15.958058 3919 raft_consensus.cc:348] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:15.958606 3919 raft_consensus.cc:374] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:15.958745 3919 raft_consensus.cc:729] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95846209e0b2437faace3030c3d03849, State: Initialized, Role: FOLLOWER
I20260809 00:46:15.958702 3922 consensus_queue.cc:260] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:15.958799 3920 raft_consensus.cc:348] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:15.959353 3920 raft_consensus.cc:374] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:15.959512 3920 raft_consensus.cc:729] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78d15b9dd63640e3a24ec9269069e8ba, State: Initialized, Role: FOLLOWER
I20260809 00:46:15.959474 3919 consensus_queue.cc:260] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:15.960549 3922 ts_tablet_manager.cc:1428] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260809 00:46:15.960747 3885 heartbeater.cc:503] Master 127.28.92.190:41669 was elected leader, sending a full tablet report...
I20260809 00:46:15.961797 3920 consensus_queue.cc:260] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:15.962694 3919 ts_tablet_manager.cc:1428] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Time spent starting tablet: real 0.016s user 0.010s sys 0.004s
I20260809 00:46:15.964905 3660 heartbeater.cc:503] Master 127.28.92.190:41669 was elected leader, sending a full tablet report...
I20260809 00:46:15.965921 3920 ts_tablet_manager.cc:1428] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Time spent starting tablet: real 0.017s user 0.013s sys 0.001s
W20260809 00:46:16.058984 3447 tablet.cc:2369] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:46:16.060122 3661 tablet.cc:2369] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:46:16.080681 3888 tablet.cc:2369] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:16.192268 3929 raft_consensus.cc:482] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:16.192652 3929 raft_consensus.cc:504] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:16.194942 3929 leader_election.cc:288] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6d7e499400e4751bf18cd35726f2ec4 (127.28.92.129:37129), 78d15b9dd63640e3a24ec9269069e8ba (127.28.92.130:34305)
I20260809 00:46:16.201557 3916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.195867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:45017 (local address 127.28.92.130:34305)
0809 00:46:16.196865 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:16.196871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:16.196893 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:46:16.197000 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:16.197005 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:16.197084 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:16.197160 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:16.197564 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.198315 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.199916 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.200690 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.200825 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.200897 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:16.201181 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 00:46:16.201305 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466}
I20260809 00:46:16.201574 3891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.195759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34305 (local address 127.28.92.131:45017)
0809 00:46:16.196058 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.196080 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:16.196216 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:16.197186 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:16.197190 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:16.197222 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:16.197415 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:16.197426 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.198444 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.198457 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:16.199764 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:16.199780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.200834 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.200841 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:16.201038 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.201063 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 00:46:16.201141 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 00:46:16.201282 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 00:46:16.201926 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.195470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:58587 (local address 127.28.92.129:37129)
0809 00:46:16.195706 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:16.195713 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:16.196964 (+ 1251us) server_negotiation.cc:407] Connection header received
0809 00:46:16.197102 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:16.197106 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:16.197171 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:16.197259 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:16.197862 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.198589 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.200271 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.201021 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.201175 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.201246 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:16.201548 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 00:46:16.201700 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:46:16.202040 3932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.196096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.28.92.131:58587)
0809 00:46:16.196845 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.196863 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:16.196993 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:16.197296 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:16.197300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:16.197328 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:16.197686 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:16.197698 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.198728 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.198734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:16.200127 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:16.200139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.201202 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.201208 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:16.201368 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.201390 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 00:46:16.201521 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 00:46:16.201648 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"mutex_wait_us":23,"thread_start_us":457,"threads_started":1}
I20260809 00:46:16.202939 3587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "286d3fe683ff48cb8004f42e47664c90" candidate_uuid: "95846209e0b2437faace3030c3d03849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78d15b9dd63640e3a24ec9269069e8ba" is_pre_election: true
I20260809 00:46:16.203462 3587 raft_consensus.cc:2454] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95846209e0b2437faace3030c3d03849 in term 0.
I20260809 00:46:16.204116 3703 leader_election.cc:302] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78d15b9dd63640e3a24ec9269069e8ba, 95846209e0b2437faace3030c3d03849; no voters:
I20260809 00:46:16.204145 3371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "286d3fe683ff48cb8004f42e47664c90" candidate_uuid: "95846209e0b2437faace3030c3d03849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6d7e499400e4751bf18cd35726f2ec4" is_pre_election: true
I20260809 00:46:16.204514 3929 raft_consensus.cc:2781] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:16.204641 3929 raft_consensus.cc:482] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:16.204583 3371 raft_consensus.cc:2454] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95846209e0b2437faace3030c3d03849 in term 0.
I20260809 00:46:16.204736 3929 raft_consensus.cc:3037] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:16.206971 3929 raft_consensus.cc:504] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:16.207580 3929 leader_election.cc:288] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [CANDIDATE]: Term 1 election: Requested vote from peers e6d7e499400e4751bf18cd35726f2ec4 (127.28.92.129:37129), 78d15b9dd63640e3a24ec9269069e8ba (127.28.92.130:34305)
I20260809 00:46:16.207917 3371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "286d3fe683ff48cb8004f42e47664c90" candidate_uuid: "95846209e0b2437faace3030c3d03849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6d7e499400e4751bf18cd35726f2ec4"
I20260809 00:46:16.207996 3587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "286d3fe683ff48cb8004f42e47664c90" candidate_uuid: "95846209e0b2437faace3030c3d03849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78d15b9dd63640e3a24ec9269069e8ba"
I20260809 00:46:16.208074 3371 raft_consensus.cc:3037] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:16.208191 3587 raft_consensus.cc:3037] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:16.210234 3371 raft_consensus.cc:2454] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95846209e0b2437faace3030c3d03849 in term 1.
I20260809 00:46:16.210502 3587 raft_consensus.cc:2454] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95846209e0b2437faace3030c3d03849 in term 1.
I20260809 00:46:16.210597 3704 leader_election.cc:302] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95846209e0b2437faace3030c3d03849, e6d7e499400e4751bf18cd35726f2ec4; no voters:
I20260809 00:46:16.210875 3929 raft_consensus.cc:2781] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:16.211272 3929 raft_consensus.cc:686] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 1 LEADER]: Becoming Leader. State: Replica: 95846209e0b2437faace3030c3d03849, State: Running, Role: LEADER
I20260809 00:46:16.211716 3929 consensus_queue.cc:237] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } }
I20260809 00:46:16.215852 3135 catalog_manager.cc:5495] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95846209e0b2437faace3030c3d03849 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "95846209e0b2437faace3030c3d03849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95846209e0b2437faace3030c3d03849" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 } health_report { overall_health: UNKNOWN } } }
I20260809 00:46:16.287225 3915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.281348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43602 (local address 127.28.92.131:45273)
0809 00:46:16.281605 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:16.281611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:16.281626 (+ 15us) server_negotiation.cc:407] Connection header received
0809 00:46:16.281752 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:16.281756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:16.281839 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:16.281999 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:16.282439 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.283477 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.285105 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.285511 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.285622 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.286139 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:16.286652 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:16.286788 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:16.286877 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 00:46:16.286970 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 00:46:16.294749 3587 raft_consensus.cc:1261] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 1 FOLLOWER]: Refusing update from remote peer 95846209e0b2437faace3030c3d03849: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:16.294788 3371 raft_consensus.cc:1261] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 1 FOLLOWER]: Refusing update from remote peer 95846209e0b2437faace3030c3d03849: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:16.295677 3934 consensus_queue.cc:1035] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78d15b9dd63640e3a24ec9269069e8ba" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:16.296000 3929 consensus_queue.cc:1035] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6d7e499400e4751bf18cd35726f2ec4" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:16.330615 3135 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:16.330912 3135 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:16.334851 3135 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8053dd8f11a433a92e8ec885e9e55b9: Sending DeleteTablet for 3 replicas of tablet 286d3fe683ff48cb8004f42e47664c90
I20260809 00:46:16.336088 3339 tablet_service.cc:1514] Processing DeleteTablet for tablet 286d3fe683ff48cb8004f42e47664c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:16 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:39952
I20260809 00:46:16.336094 3778 tablet_service.cc:1514] Processing DeleteTablet for tablet 286d3fe683ff48cb8004f42e47664c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:16 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:43586
I20260809 00:46:16.336848 3555 tablet_service.cc:1514] Processing DeleteTablet for tablet 286d3fe683ff48cb8004f42e47664c90 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:16 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:43106
I20260809 00:46:16.338251 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 3234
I20260809 00:46:16.348552 3961 tablet_replica.cc:330] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: stopping tablet replica
I20260809 00:46:16.350332 3961 raft_consensus.cc:2229] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 1 FOLLOWER]: Raft consensus shutting down.
Aug 09 00:46:16 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:16.352321 3961 raft_consensus.cc:2258] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:16.353479 3960 tablet_replica.cc:330] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: stopping tablet replica
I20260809 00:46:16.354166 3960 raft_consensus.cc:2229] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:16.354797 3960 raft_consensus.cc:2258] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:16.355466 3958 tablet_replica.cc:330] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: stopping tablet replica
I20260809 00:46:16.356287 3958 raft_consensus.cc:2229] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:16.356582 3961 ts_tablet_manager.cc:1905] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:16.358289 3958 raft_consensus.cc:2258] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:16.359135 3960 ts_tablet_manager.cc:1905] T 286d3fe683ff48cb8004f42e47664c90 P e6d7e499400e4751bf18cd35726f2ec4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:16.360327 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.339991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39954 (local address 127.28.92.129:37129)
0809 00:46:16.340182 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:16.340189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:16.340383 (+ 194us) server_negotiation.cc:407] Connection header received
0809 00:46:16.340667 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:16.340674 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:16.340766 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:16.340841 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:16.342642 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.343798 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.345646 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.346328 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.346447 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.352243 (+ 5796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:16.352265 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:16.352287 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:16.352335 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:16.356518 (+ 4183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:16.357484 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:16.357494 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:16.357498 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:16.357721 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:16.358233 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:16.358239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:16.358242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:16.358720 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:16.359038 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:16.359665 (+ 627us) server_negotiation.cc:299] Negotiation successful
0809 00:46:16.359910 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:46:16.362375 3438 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:16.363473 3958 ts_tablet_manager.cc:1905] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:16.366511 3961 ts_tablet_manager.cc:1918] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:16.366693 3961 log.cc:1196] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/286d3fe683ff48cb8004f42e47664c90
I20260809 00:46:16.367267 3961 ts_tablet_manager.cc:1939] T 286d3fe683ff48cb8004f42e47664c90 P 78d15b9dd63640e3a24ec9269069e8ba: Deleting consensus metadata
I20260809 00:46:16.369289 3114 catalog_manager.cc:4841] TS 78d15b9dd63640e3a24ec9269069e8ba (127.28.92.130:34305): tablet 286d3fe683ff48cb8004f42e47664c90 (table test-table [id=60e34db8a8c94449a131cdfffa77778a]) successfully deleted
I20260809 00:46:16.370829 3958 ts_tablet_manager.cc:1918] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:16.371091 3958 log.cc:1196] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/286d3fe683ff48cb8004f42e47664c90
I20260809 00:46:16.371783 3958 ts_tablet_manager.cc:1939] T 286d3fe683ff48cb8004f42e47664c90 P 95846209e0b2437faace3030c3d03849: Deleting consensus metadata
I20260809 00:46:16.373859 3111 catalog_manager.cc:4841] TS 95846209e0b2437faace3030c3d03849 (127.28.92.131:45273): tablet 286d3fe683ff48cb8004f42e47664c90 (table test-table [id=60e34db8a8c94449a131cdfffa77778a]) successfully deleted
I20260809 00:46:16.462869 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 3234
W20260809 00:46:16.492790 3116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:37129 (error 108)
I20260809 00:46:16.493626 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 3453
I20260809 00:46:16.495491 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.494273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:39956)
0809 00:46:16.495058 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.495261 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":586,"threads_started":1}
W20260809 00:46:16.495779 3116 catalog_manager.cc:4584] TS e6d7e499400e4751bf18cd35726f2ec4 (127.28.92.129:37129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 286d3fe683ff48cb8004f42e47664c90: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Aug 09 00:46:16 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:46:16.510679 3916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.494506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43118 (local address 127.28.92.130:34305)
0809 00:46:16.494700 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:16.494707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:16.494731 (+ 24us) server_negotiation.cc:407] Connection header received
0809 00:46:16.494961 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:16.494967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:16.495064 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:16.495164 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:16.496728 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.497900 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.499117 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.499751 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.499878 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.504208 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:16.504228 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:16.504255 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:16.504300 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:16.507901 (+ 3601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:16.508557 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:16.508568 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:16.508571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:16.508740 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:16.509076 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:16.509081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:16.509085 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:16.509557 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:16.509869 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:16.510086 (+ 217us) server_negotiation.cc:299] Negotiation successful
0809 00:46:16.510304 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:46:16.511359 3647 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:16.549921 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.549314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:39970)
0809 00:46:16.549579 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.549742 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260809 00:46:16.551209 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.550756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:39986)
0809 00:46:16.550948 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.551038 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 00:46:16.599972 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 3453
I20260809 00:46:16.611837 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.611398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:40002)
0809 00:46:16.611598 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.611686 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 00:46:16.612912 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.612553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:40014)
0809 00:46:16.612700 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.612773 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 00:46:16.629340 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 3670
Aug 09 00:46:16 dist-test-slave-t7g5 krb5kdc[3064](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236373, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:46:16.647153 3915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.630217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43604 (local address 127.28.92.131:45273)
0809 00:46:16.630385 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:16.630390 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:16.630408 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:46:16.630603 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:16.630607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:16.630666 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:16.630743 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:16.632422 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.633229 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.635150 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:16.635632 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:16.635732 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:16.641157 (+ 5425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:16.641173 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:16.641192 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:16.641246 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:16.644335 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:16.645104 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:16.645111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:16.645113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:16.645261 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:16.645705 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:16.645710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:16.645713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:16.646098 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:16.646329 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:16.646680 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 00:46:16.646835 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 00:46:16.647893 3873 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:16.693356 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.692869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:40028)
0809 00:46:16.693093 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.693188 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 00:46:16.694568 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.694142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:40030)
0809 00:46:16.694351 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.694427 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260809 00:46:16.768342 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 3670
I20260809 00:46:16.795516 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 3088
I20260809 00:46:16.796729 3188 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:16.903086 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:16.902370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:37129 (local address 127.0.0.1:40034)
0809 00:46:16.902736 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:16.902870 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:37129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260809 00:46:16.903297 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 3088
2026-08-09T00:46:16Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4482 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T00:46:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:16Z Disabled control of system clock
I20260809 00:46:16.975359 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35813
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:35813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 00:46:17.303239 3979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:17.303606 3979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:17.303732 3979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:17.311112 3979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:17.311246 3979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:17.311311 3979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:17.311393 3979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:17.311458 3979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:17.320779 3979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:35813
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:17.322154 3979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:17.324041 3979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:17.335356 3987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:17.335428 3986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:17.335405 3990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:17.336090 3979 server_base.cc:1034] running on GCE node
I20260809 00:46:17.336840 3979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:17.338279 3979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:17.339483 3979 hybrid_clock.cc:648] HybridClock initialized: now 1786236377339429 us; error 43 us; skew 500 ppm
I20260809 00:46:17.339823 3979 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:17.342073 3979 webserver.cc:460] Webserver started at http://127.28.92.190:40619/ using document root <none> and password file <none>
I20260809 00:46:17.342774 3979 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:17.342880 3979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:17.343206 3979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:17.346092 3979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "6fc68ce3678248ec8f73753292f975b1"
format_stamp: "Formatted at 2026-08-09 00:46:17 on dist-test-slave-t7g5"
server_key: "a4ed8d70d7b896405eaabbbb552f0eab"
server_key_iv: "344af972f01720726c0653a1db9180f3"
server_key_version: "encryptionkey@0"
I20260809 00:46:17.346875 3979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "6fc68ce3678248ec8f73753292f975b1"
format_stamp: "Formatted at 2026-08-09 00:46:17 on dist-test-slave-t7g5"
server_key: "a4ed8d70d7b896405eaabbbb552f0eab"
server_key_iv: "344af972f01720726c0653a1db9180f3"
server_key_version: "encryptionkey@0"
I20260809 00:46:17.352016 3979 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:17.355382 3998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:17.356635 3979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:17.356798 3979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "6fc68ce3678248ec8f73753292f975b1"
format_stamp: "Formatted at 2026-08-09 00:46:17 on dist-test-slave-t7g5"
server_key: "a4ed8d70d7b896405eaabbbb552f0eab"
server_key_iv: "344af972f01720726c0653a1db9180f3"
server_key_version: "encryptionkey@0"
I20260809 00:46:17.357005 3979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:17.362519 3979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:17.363265 3979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:17.363538 3979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:17.380587 3979 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:35813
I20260809 00:46:17.380640 4096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:35813 every 8 connection(s)
I20260809 00:46:17.381889 3979 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:17.383155 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 3979
I20260809 00:46:17.383373 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:17.384286 29042 external_mini_cluster.cc:1428] Setting key 8ec7a75afd92bc6a748091917f052481
I20260809 00:46:17.386782 4097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:17.392726 4102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:17.386511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57850 (local address 127.28.92.190:35813)
0809 00:46:17.387541 (+ 1030us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:17.387552 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:17.387591 (+ 39us) server_negotiation.cc:407] Connection header received
0809 00:46:17.389155 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:17.389177 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:17.389594 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:17.390000 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:17.391088 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:17.391098 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:17.391110 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:17.391125 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:17.391206 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:17.391224 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:17.391432 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:17.391590 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 00:46:17.391839 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":395,"threads_started":1}
I20260809 00:46:17.399305 4097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1: Bootstrap starting.
I20260809 00:46:17.402554 4097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:17.403600 4097 log.cc:824] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:17.406426 4097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1: No bootstrap required, opened a new log
I20260809 00:46:17.414017 4097 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc68ce3678248ec8f73753292f975b1" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35813 } }
I20260809 00:46:17.414418 4097 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:17.414531 4097 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc68ce3678248ec8f73753292f975b1, State: Initialized, Role: FOLLOWER
I20260809 00:46:17.415160 4097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc68ce3678248ec8f73753292f975b1" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35813 } }
I20260809 00:46:17.415421 4097 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:17.415580 4097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:17.415771 4097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:17.418102 4097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc68ce3678248ec8f73753292f975b1" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35813 } }
I20260809 00:46:17.418624 4097 leader_election.cc:302] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fc68ce3678248ec8f73753292f975b1; no voters:
I20260809 00:46:17.419235 4097 leader_election.cc:288] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:17.419353 4105 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:17.420039 4105 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [term 1 LEADER]: Becoming Leader. State: Replica: 6fc68ce3678248ec8f73753292f975b1, State: Running, Role: LEADER
I20260809 00:46:17.420562 4105 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc68ce3678248ec8f73753292f975b1" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35813 } }
I20260809 00:46:17.421372 4097 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:17.423184 4108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fc68ce3678248ec8f73753292f975b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc68ce3678248ec8f73753292f975b1" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35813 } } }
I20260809 00:46:17.423561 4108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:17.423905 4110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fc68ce3678248ec8f73753292f975b1. Latest consensus state: current_term: 1 leader_uuid: "6fc68ce3678248ec8f73753292f975b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc68ce3678248ec8f73753292f975b1" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35813 } } }
I20260809 00:46:17.424254 4110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:17.426540 4114 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:17.431916 4114 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:17.440954 4114 catalog_manager.cc:1347] Generated new cluster ID: cfea0887e66a4c899dea78e6de6bae9f
I20260809 00:46:17.441097 4114 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:17.452888 4114 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:17.453398 4114 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:17.476797 4114 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1: Generated new TSK 0
I20260809 00:46:17.478001 4114 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:46:17.492254 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35813
--builtin_ntp_servers=127.28.92.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 00:46:17.820060 4136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:17.820389 4136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:17.820518 4136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:17.828153 4136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:17.828295 4136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:17.828457 4136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:17.837850 4136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35813
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:17.839303 4136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:17.841152 4136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:17.854192 4144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:17.854235 4147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:17.854153 4149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:17.855158 4136 server_base.cc:1034] running on GCE node
I20260809 00:46:17.855794 4136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:17.856774 4136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:17.857986 4136 hybrid_clock.cc:648] HybridClock initialized: now 1786236377857927 us; error 51 us; skew 500 ppm
I20260809 00:46:17.858304 4136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:17.860615 4136 webserver.cc:460] Webserver started at http://127.28.92.129:34977/ using document root <none> and password file <none>
I20260809 00:46:17.861325 4136 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:17.861433 4136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:17.861819 4136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:17.864693 4136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "e18d457d0503406aa9088597f4eb362d"
format_stamp: "Formatted at 2026-08-09 00:46:17 on dist-test-slave-t7g5"
server_key: "451d3378088d3d95e250fecded2cb2a6"
server_key_iv: "02a57689d0f421cbf3d06dada5091222"
server_key_version: "encryptionkey@0"
I20260809 00:46:17.865486 4136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "e18d457d0503406aa9088597f4eb362d"
format_stamp: "Formatted at 2026-08-09 00:46:17 on dist-test-slave-t7g5"
server_key: "451d3378088d3d95e250fecded2cb2a6"
server_key_iv: "02a57689d0f421cbf3d06dada5091222"
server_key_version: "encryptionkey@0"
I20260809 00:46:17.870764 4136 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 00:46:17.874276 4164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:17.875685 4136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:46:17.875828 4136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "e18d457d0503406aa9088597f4eb362d"
format_stamp: "Formatted at 2026-08-09 00:46:17 on dist-test-slave-t7g5"
server_key: "451d3378088d3d95e250fecded2cb2a6"
server_key_iv: "02a57689d0f421cbf3d06dada5091222"
server_key_version: "encryptionkey@0"
I20260809 00:46:17.876026 4136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:17.881829 4136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:17.882606 4136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:17.882838 4136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:17.883682 4136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:17.885047 4136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:17.885134 4136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:17.885216 4136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:17.885270 4136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:17.915252 4136 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:41067
I20260809 00:46:17.915331 4349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:41067 every 8 connection(s)
I20260809 00:46:17.916620 4136 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:17.924638 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:17.919118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:50401 (local address 127.28.92.190:35813)
0809 00:46:17.919549 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:17.919554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:17.920732 (+ 1178us) server_negotiation.cc:407] Connection header received
0809 00:46:17.922498 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:17.922504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:17.922567 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:17.922662 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:17.923883 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:17.923889 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:17.923894 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:17.923910 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:17.923954 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:17.923966 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:17.924070 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:17.924252 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 00:46:17.924319 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":195,"threads_started":1}
I20260809 00:46:17.925576 4355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:17.919704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35813 (local address 127.28.92.129:50401)
0809 00:46:17.920587 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:17.920622 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:17.922235 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:17.922892 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:17.922901 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:17.922999 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:17.923598 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:17.923600 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:17.923637 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:17.923719 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:17.924051 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:17.924061 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:17.924068 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 00:46:17.924316 (+ 248us) client_negotiation.cc:240] Negotiation successful
0809 00:46:17.924567 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":257,"threads_started":1}
I20260809 00:46:17.925806 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 4136
I20260809 00:46:17.926002 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:17.926797 29042 external_mini_cluster.cc:1428] Setting key 6f37195222a717bfc87ad4e7c706988c
I20260809 00:46:17.927126 4350 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35813
I20260809 00:46:17.927438 4350 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:17.928112 4350 heartbeater.cc:511] Master 127.28.92.190:35813 requested a full tablet report, sending...
I20260809 00:46:17.929620 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35813
--builtin_ntp_servers=127.28.92.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 00:46:17.930176 4032 ts_manager.cc:194] Registered new tserver with Master: e18d457d0503406aa9088597f4eb362d (127.28.92.129:41067)
W20260809 00:46:18.256660 4359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:18.256953 4359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:18.257082 4359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:18.264443 4359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:18.264561 4359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:18.264709 4359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:18.273860 4359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35813
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:18.275224 4359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:18.277101 4359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:18.289808 4365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:18.289744 4366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:18.289769 4368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:18.290565 4359 server_base.cc:1034] running on GCE node
I20260809 00:46:18.291112 4359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:18.291978 4359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:18.293176 4359 hybrid_clock.cc:648] HybridClock initialized: now 1786236378293125 us; error 37 us; skew 500 ppm
I20260809 00:46:18.293488 4359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:18.296093 4359 webserver.cc:460] Webserver started at http://127.28.92.130:33995/ using document root <none> and password file <none>
I20260809 00:46:18.296872 4359 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:18.297008 4359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:18.297406 4359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:18.300455 4359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "2332d70d6a58435ea2b529337b45acc8"
format_stamp: "Formatted at 2026-08-09 00:46:18 on dist-test-slave-t7g5"
server_key: "2e2118990cba909c33c64dc891bcdb1a"
server_key_iv: "15a3d8995c690e56c5e65ada0624f37a"
server_key_version: "encryptionkey@0"
I20260809 00:46:18.301254 4359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "2332d70d6a58435ea2b529337b45acc8"
format_stamp: "Formatted at 2026-08-09 00:46:18 on dist-test-slave-t7g5"
server_key: "2e2118990cba909c33c64dc891bcdb1a"
server_key_iv: "15a3d8995c690e56c5e65ada0624f37a"
server_key_version: "encryptionkey@0"
I20260809 00:46:18.306353 4359 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:46:18.309808 4377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:18.311080 4359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:46:18.311228 4359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "2332d70d6a58435ea2b529337b45acc8"
format_stamp: "Formatted at 2026-08-09 00:46:18 on dist-test-slave-t7g5"
server_key: "2e2118990cba909c33c64dc891bcdb1a"
server_key_iv: "15a3d8995c690e56c5e65ada0624f37a"
server_key_version: "encryptionkey@0"
I20260809 00:46:18.311425 4359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:18.316895 4359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:18.317644 4359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:18.317921 4359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:18.318856 4359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:18.320173 4359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:18.320261 4359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:18.320367 4359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:18.320434 4359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:18.350625 4359 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:39003
I20260809 00:46:18.350692 4583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:39003 every 8 connection(s)
I20260809 00:46:18.351954 4359 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:18.359165 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 4359
I20260809 00:46:18.359342 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:18.359679 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.354445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:34991 (local address 127.28.92.190:35813)
0809 00:46:18.354626 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:18.354631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:18.355999 (+ 1368us) server_negotiation.cc:407] Connection header received
0809 00:46:18.357592 (+ 1593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:18.357596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:18.357673 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:18.357762 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:18.359015 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:18.359019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:18.359022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:18.359038 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:18.359072 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:18.359084 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:18.359178 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:18.359420 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 00:46:18.359492 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:46:18.359908 29042 external_mini_cluster.cc:1428] Setting key 040b32b32690bab619ec67e2bb96f130
I20260809 00:46:18.360818 4588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.354978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35813 (local address 127.28.92.130:34991)
0809 00:46:18.355863 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:18.355907 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:18.357352 (+ 1445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:18.357963 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:18.357970 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:18.358055 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:18.358676 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:18.358678 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:18.358721 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:18.358819 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:18.359173 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:18.359184 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:18.359191 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 00:46:18.359477 (+ 286us) client_negotiation.cc:240] Negotiation successful
0809 00:46:18.359723 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":253,"threads_started":1}
I20260809 00:46:18.362097 4585 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35813
I20260809 00:46:18.362360 4585 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:18.362709 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35813
--builtin_ntp_servers=127.28.92.148:37777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 00:46:18.362946 4585 heartbeater.cc:511] Master 127.28.92.190:35813 requested a full tablet report, sending...
I20260809 00:46:18.364372 4031 ts_manager.cc:194] Registered new tserver with Master: 2332d70d6a58435ea2b529337b45acc8 (127.28.92.130:39003)
W20260809 00:46:18.683369 4589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:18.683660 4589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:18.683758 4589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:18.690905 4589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:18.691020 4589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:18.691140 4589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:18.700248 4589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35813
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:18.701561 4589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:18.703384 4589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:18.717152 4597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:18.717232 4603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:18.717202 4596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:18.717720 4589 server_base.cc:1034] running on GCE node
I20260809 00:46:18.718390 4589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:18.719350 4589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:18.720559 4589 hybrid_clock.cc:648] HybridClock initialized: now 1786236378720508 us; error 40 us; skew 500 ppm
I20260809 00:46:18.720950 4589 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:18.723380 4589 webserver.cc:460] Webserver started at http://127.28.92.131:45753/ using document root <none> and password file <none>
I20260809 00:46:18.724071 4589 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:18.724170 4589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:18.724516 4589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:18.727599 4589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "6a3a471835c64df4b1926faa14d1253f"
format_stamp: "Formatted at 2026-08-09 00:46:18 on dist-test-slave-t7g5"
server_key: "4b1eeb7624377b4082d07c3458deaccf"
server_key_iv: "06a3da53dc049e19d3bdcab7ae119164"
server_key_version: "encryptionkey@0"
I20260809 00:46:18.728381 4589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "6a3a471835c64df4b1926faa14d1253f"
format_stamp: "Formatted at 2026-08-09 00:46:18 on dist-test-slave-t7g5"
server_key: "4b1eeb7624377b4082d07c3458deaccf"
server_key_iv: "06a3da53dc049e19d3bdcab7ae119164"
server_key_version: "encryptionkey@0"
I20260809 00:46:18.733496 4589 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:46:18.736848 4612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:18.738193 4589 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:18.738381 4589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "6a3a471835c64df4b1926faa14d1253f"
format_stamp: "Formatted at 2026-08-09 00:46:18 on dist-test-slave-t7g5"
server_key: "4b1eeb7624377b4082d07c3458deaccf"
server_key_iv: "06a3da53dc049e19d3bdcab7ae119164"
server_key_version: "encryptionkey@0"
I20260809 00:46:18.738588 4589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:18.744110 4589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:18.744939 4589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:18.745191 4589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:18.746176 4589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:18.747596 4589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:18.747687 4589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:18.747799 4589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:18.747870 4589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:18.777938 4589 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:44371
I20260809 00:46:18.777997 4796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:44371 every 8 connection(s)
I20260809 00:46:18.779304 4589 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:18.782658 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 4589
I20260809 00:46:18.782842 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:18.783396 29042 external_mini_cluster.cc:1428] Setting key 6134c15c0e1d516aa8fa561e72f486e5
I20260809 00:46:18.787577 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.781857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:50339 (local address 127.28.92.190:35813)
0809 00:46:18.782029 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:18.782034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:18.783628 (+ 1594us) server_negotiation.cc:407] Connection header received
0809 00:46:18.785385 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:18.785390 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:18.785455 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:18.785538 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:18.787023 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:18.787027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:18.787030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:18.787046 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:18.787080 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:18.787091 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:18.787188 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:18.787311 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 00:46:18.787358 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:46:18.788488 4804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.782454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35813 (local address 127.28.92.131:50339)
0809 00:46:18.783463 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:18.783513 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:18.785126 (+ 1613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:18.785845 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:18.785857 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:18.785981 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:18.786734 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:18.786737 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:18.786778 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:18.786872 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:18.787166 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:18.787171 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:18.787176 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:46:18.787388 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 00:46:18.787584 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":360,"threads_started":1}
I20260809 00:46:18.789723 4802 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35813
I20260809 00:46:18.789971 4802 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:18.790516 4802 heartbeater.cc:511] Master 127.28.92.190:35813 requested a full tablet report, sending...
I20260809 00:46:18.791719 4031 ts_manager.cc:194] Registered new tserver with Master: 6a3a471835c64df4b1926faa14d1253f (127.28.92.131:44371)
I20260809 00:46:18.798846 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:46:18.805222 4354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.803020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57858 (local address 127.28.92.190:35813)
0809 00:46:18.803199 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:18.803205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:18.803648 (+ 443us) server_negotiation.cc:407] Connection header received
0809 00:46:18.803772 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:18.803776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:18.803839 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:18.803914 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:18.804696 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:18.804700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:18.804703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:18.804718 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:18.804750 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:18.804761 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:18.804862 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:18.804912 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 00:46:18.804955 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 00:46:18.808941 4031 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:18.815784 4031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:18.833568 4823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.828253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47516 (local address 127.28.92.130:39003)
0809 00:46:18.830067 (+ 1814us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:18.830075 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:18.830616 (+ 541us) server_negotiation.cc:407] Connection header received
0809 00:46:18.830742 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:18.830750 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:18.830965 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:18.831688 (+ 723us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:18.832639 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:18.832649 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:18.832664 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:18.832689 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:18.832746 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:18.832767 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:18.832932 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:18.833095 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 00:46:18.833205 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1635,"thread_start_us":1520,"threads_started":1}
I20260809 00:46:18.833611 4820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.827646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:39003 (local address 127.0.0.1:47516)
0809 00:46:18.830489 (+ 2843us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:18.830508 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:18.830626 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:18.831135 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:18.831139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:18.831160 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:18.832198 (+ 1038us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:18.832202 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:18.832232 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:18.832319 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:18.832876 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:18.832889 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:18.832901 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 00:46:18.833100 (+ 199us) client_negotiation.cc:240] Negotiation successful
0809 00:46:18.833194 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2713,"thread_start_us":2560,"threads_started":1}
I20260809 00:46:18.834677 4821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.827833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51146 (local address 127.28.92.131:44371)
0809 00:46:18.829322 (+ 1489us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:18.829331 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:18.829368 (+ 37us) server_negotiation.cc:407] Connection header received
0809 00:46:18.829439 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:18.829445 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:18.829722 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:18.829874 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:18.833347 (+ 3473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:18.833357 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:18.833370 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:18.833390 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:18.833451 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:18.833475 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:18.833641 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:18.834216 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 00:46:18.834311 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1319,"thread_start_us":1147,"threads_started":1}
I20260809 00:46:18.834677 4819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.827475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:44371 (local address 127.0.0.1:51146)
0809 00:46:18.828198 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:18.828243 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:18.828395 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:18.831006 (+ 2611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:18.831016 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:18.831114 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:18.832563 (+ 1449us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:18.832566 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:18.832581 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:18.832626 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:18.834070 (+ 1444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:18.834075 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:18.834080 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:46:18.834206 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 00:46:18.834259 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":295,"threads_started":1}
I20260809 00:46:18.835573 4827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.830402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.28.92.129:41067)
0809 00:46:18.831095 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:18.831104 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:18.832291 (+ 1187us) server_negotiation.cc:407] Connection header received
0809 00:46:18.832398 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:18.832405 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:18.832603 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:18.832752 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:18.834164 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:18.834173 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:18.834185 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:18.834211 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:18.834268 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:18.834287 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:18.834411 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:18.835155 (+ 744us) server_negotiation.cc:299] Negotiation successful
0809 00:46:18.835250 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":412,"threads_started":1}
I20260809 00:46:18.838076 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:18.829890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:42950)
0809 00:46:18.832161 (+ 2271us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:18.832179 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:18.832285 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:18.832748 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:18.832752 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:18.832775 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:18.833934 (+ 1159us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:18.833937 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:18.833964 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:18.834009 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:18.834474 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:18.834479 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:18.834484 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:46:18.834644 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 00:46:18.834698 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1669,"thread_start_us":1566,"threads_started":1}
I20260809 00:46:18.837792 4470 tablet_service.cc:1467] Processing CreateTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 (DEFAULT_TABLE table=test-table [id=04bb81ae0b43442a9cc8a8ef14cd1665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:18.838287 4692 tablet_service.cc:1467] Processing CreateTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 (DEFAULT_TABLE table=test-table [id=04bb81ae0b43442a9cc8a8ef14cd1665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:18.839434 4470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8900f6600fb4ddb9c47772e9fbcbf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:18.839687 4692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8900f6600fb4ddb9c47772e9fbcbf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:18.840983 4250 tablet_service.cc:1467] Processing CreateTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 (DEFAULT_TABLE table=test-table [id=04bb81ae0b43442a9cc8a8ef14cd1665]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:18.842105 4250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8900f6600fb4ddb9c47772e9fbcbf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:18.853926 4829 tablet_bootstrap.cc:492] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Bootstrap starting.
I20260809 00:46:18.857286 4829 tablet_bootstrap.cc:654] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:18.858673 4829 log.cc:824] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:18.861750 4829 tablet_bootstrap.cc:492] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: No bootstrap required, opened a new log
I20260809 00:46:18.862074 4829 ts_tablet_manager.cc:1397] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 00:46:18.862437 4834 tablet_bootstrap.cc:492] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Bootstrap starting.
I20260809 00:46:18.865876 4830 tablet_bootstrap.cc:492] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Bootstrap starting.
I20260809 00:46:18.866156 4834 tablet_bootstrap.cc:654] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:18.867412 4834 log.cc:824] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:18.868598 4830 tablet_bootstrap.cc:654] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:18.869575 4830 log.cc:824] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:18.870821 4834 tablet_bootstrap.cc:492] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: No bootstrap required, opened a new log
I20260809 00:46:18.871101 4834 ts_tablet_manager.cc:1397] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 00:46:18.871894 4830 tablet_bootstrap.cc:492] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: No bootstrap required, opened a new log
I20260809 00:46:18.872133 4830 ts_tablet_manager.cc:1397] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20260809 00:46:18.871912 4829 raft_consensus.cc:348] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:18.872399 4829 raft_consensus.cc:374] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:18.872511 4829 raft_consensus.cc:729] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e18d457d0503406aa9088597f4eb362d, State: Initialized, Role: FOLLOWER
I20260809 00:46:18.873159 4829 consensus_queue.cc:260] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:18.878394 4350 heartbeater.cc:503] Master 127.28.92.190:35813 was elected leader, sending a full tablet report...
I20260809 00:46:18.880084 4830 raft_consensus.cc:348] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:18.880617 4830 raft_consensus.cc:374] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:18.880764 4830 raft_consensus.cc:729] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2332d70d6a58435ea2b529337b45acc8, State: Initialized, Role: FOLLOWER
I20260809 00:46:18.880805 4829 ts_tablet_manager.cc:1428] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Time spent starting tablet: real 0.019s user 0.013s sys 0.003s
I20260809 00:46:18.881561 4830 consensus_queue.cc:260] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:18.881542 4834 raft_consensus.cc:348] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:18.881913 4834 raft_consensus.cc:374] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:18.882022 4834 raft_consensus.cc:729] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3a471835c64df4b1926faa14d1253f, State: Initialized, Role: FOLLOWER
I20260809 00:46:18.882730 4585 heartbeater.cc:503] Master 127.28.92.190:35813 was elected leader, sending a full tablet report...
I20260809 00:46:18.882781 4834 consensus_queue.cc:260] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:18.883420 4830 ts_tablet_manager.cc:1428] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260809 00:46:18.883908 4802 heartbeater.cc:503] Master 127.28.92.190:35813 was elected leader, sending a full tablet report...
I20260809 00:46:18.884609 4834 ts_tablet_manager.cc:1428] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
W20260809 00:46:18.918872 4353 tablet.cc:2369] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:46:19.031006 4803 tablet.cc:2369] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:19.053629 4842 raft_consensus.cc:482] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:19.053989 4842 raft_consensus.cc:504] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:19.055716 4842 leader_election.cc:288] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a3a471835c64df4b1926faa14d1253f (127.28.92.131:44371), 2332d70d6a58435ea2b529337b45acc8 (127.28.92.130:39003)
I20260809 00:46:19.059165 4823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.056302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:36185 (local address 127.28.92.130:39003)
0809 00:46:19.056495 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:19.056501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:19.057098 (+ 597us) server_negotiation.cc:407] Connection header received
0809 00:46:19.057325 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:19.057332 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:19.057410 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:19.057516 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:19.058546 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:19.058552 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:19.058557 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:19.058577 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:19.058619 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:19.058634 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:19.058778 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:19.058829 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 00:46:19.058894 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:46:19.059166 4821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.056311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54043 (local address 127.28.92.131:44371)
0809 00:46:19.056493 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:19.056499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:19.057646 (+ 1147us) server_negotiation.cc:407] Connection header received
0809 00:46:19.057789 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:19.057792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:19.057843 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:19.057916 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:19.058603 (+ 687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:19.058608 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:19.058612 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:19.058630 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:19.058665 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:19.058680 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:19.058794 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:19.058860 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 00:46:19.058913 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:46:19.059478 4847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.056238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:39003 (local address 127.28.92.129:36185)
0809 00:46:19.056978 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.056994 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:19.057126 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:19.057587 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:19.057592 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:19.057615 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:19.058321 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:19.058325 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:19.058345 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:19.058398 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:19.058732 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:19.058736 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:19.058741 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:46:19.058883 (+ 142us) client_negotiation.cc:240] Negotiation successful
0809 00:46:19.058962 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":408,"threads_started":1}
I20260809 00:46:19.059507 4846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.056249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:44371 (local address 127.28.92.129:54043)
0809 00:46:19.057536 (+ 1287us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.057551 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:19.057673 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:19.057972 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:19.057976 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:19.058000 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:19.058412 (+ 412us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:46:19.058415 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:19.058427 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:46:19.058470 (+ 43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:19.058760 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:19.058764 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:19.058774 (+ 10us) client_negotiation.cc:769] Sending connection context
0809 00:46:19.058908 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 00:46:19.058972 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"mutex_wait_us":70,"thread_start_us":946,"threads_started":1}
I20260809 00:46:19.060534 4727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8900f6600fb4ddb9c47772e9fbcbf88" candidate_uuid: "e18d457d0503406aa9088597f4eb362d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3a471835c64df4b1926faa14d1253f" is_pre_election: true
I20260809 00:46:19.060580 4502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8900f6600fb4ddb9c47772e9fbcbf88" candidate_uuid: "e18d457d0503406aa9088597f4eb362d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2332d70d6a58435ea2b529337b45acc8" is_pre_election: true
I20260809 00:46:19.061115 4502 raft_consensus.cc:2454] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e18d457d0503406aa9088597f4eb362d in term 0.
I20260809 00:46:19.061111 4727 raft_consensus.cc:2454] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e18d457d0503406aa9088597f4eb362d in term 0.
I20260809 00:46:19.061784 4166 leader_election.cc:302] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3a471835c64df4b1926faa14d1253f, e18d457d0503406aa9088597f4eb362d; no voters:
I20260809 00:46:19.062202 4842 raft_consensus.cc:2781] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:19.062330 4842 raft_consensus.cc:482] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:19.062422 4842 raft_consensus.cc:3037] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:19.064595 4842 raft_consensus.cc:504] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:19.065218 4842 leader_election.cc:288] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [CANDIDATE]: Term 1 election: Requested vote from peers 6a3a471835c64df4b1926faa14d1253f (127.28.92.131:44371), 2332d70d6a58435ea2b529337b45acc8 (127.28.92.130:39003)
I20260809 00:46:19.065694 4502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8900f6600fb4ddb9c47772e9fbcbf88" candidate_uuid: "e18d457d0503406aa9088597f4eb362d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2332d70d6a58435ea2b529337b45acc8"
I20260809 00:46:19.065701 4727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8900f6600fb4ddb9c47772e9fbcbf88" candidate_uuid: "e18d457d0503406aa9088597f4eb362d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a3a471835c64df4b1926faa14d1253f"
I20260809 00:46:19.065889 4502 raft_consensus.cc:3037] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:19.065881 4727 raft_consensus.cc:3037] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:19.068040 4727 raft_consensus.cc:2454] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e18d457d0503406aa9088597f4eb362d in term 1.
I20260809 00:46:19.068105 4502 raft_consensus.cc:2454] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e18d457d0503406aa9088597f4eb362d in term 1.
I20260809 00:46:19.068434 4166 leader_election.cc:302] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a3a471835c64df4b1926faa14d1253f, e18d457d0503406aa9088597f4eb362d; no voters:
I20260809 00:46:19.068732 4842 raft_consensus.cc:2781] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:19.069151 4842 raft_consensus.cc:686] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 1 LEADER]: Becoming Leader. State: Replica: e18d457d0503406aa9088597f4eb362d, State: Running, Role: LEADER
I20260809 00:46:19.069612 4842 consensus_queue.cc:237] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } }
I20260809 00:46:19.074088 4030 catalog_manager.cc:5495] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d reported cstate change: term changed from 0 to 1, leader changed from <none> to e18d457d0503406aa9088597f4eb362d (127.28.92.129). New cstate: current_term: 1 leader_uuid: "e18d457d0503406aa9088597f4eb362d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e18d457d0503406aa9088597f4eb362d" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41067 } health_report { overall_health: HEALTHY } } }
W20260809 00:46:19.103891 4587 tablet.cc:2369] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:19.137871 4827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.135697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42954 (local address 127.28.92.129:41067)
0809 00:46:19.135902 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:19.135908 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:19.136015 (+ 107us) server_negotiation.cc:407] Connection header received
0809 00:46:19.136242 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:19.136246 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:19.136331 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:19.136435 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:19.137248 (+ 813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:19.137252 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:19.137255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:19.137271 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:19.137303 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:19.137314 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:19.137424 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:19.137523 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 00:46:19.137580 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 00:46:19.146255 4502 raft_consensus.cc:1261] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 1 FOLLOWER]: Refusing update from remote peer e18d457d0503406aa9088597f4eb362d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:19.146253 4727 raft_consensus.cc:1261] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 1 FOLLOWER]: Refusing update from remote peer e18d457d0503406aa9088597f4eb362d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:19.147214 4842 consensus_queue.cc:1035] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a3a471835c64df4b1926faa14d1253f" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 44371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:19.147521 4849 consensus_queue.cc:1035] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2332d70d6a58435ea2b529337b45acc8" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:19.160281 4858 mvcc.cc:205] Tried to move back new op lower bound from 7316424208972357632 to 7316424208673218560. Current Snapshot: MvccSnapshot[applied={T|T < 7316424208972357632}]
I20260809 00:46:19.172555 4031 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:19.172847 4031 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:19.176677 4031 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fc68ce3678248ec8f73753292f975b1: Sending DeleteTablet for 3 replicas of tablet e8900f6600fb4ddb9c47772e9fbcbf88
I20260809 00:46:19.177637 4692 tablet_service.cc:1514] Processing DeleteTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:19 UTC) from {username='slave'} at 127.0.0.1:51146
I20260809 00:46:19.178133 4250 tablet_service.cc:1514] Processing DeleteTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:19 UTC) from {username='slave'} at 127.0.0.1:42950
I20260809 00:46:19.178118 4470 tablet_service.cc:1514] Processing DeleteTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:19 UTC) from {username='slave'} at 127.0.0.1:47516
I20260809 00:46:19.178651 4468 tablet_service.cc:1514] Processing DeleteTablet for tablet e8900f6600fb4ddb9c47772e9fbcbf88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:19 UTC) from {username='slave'} at 127.0.0.1:47516
I20260809 00:46:19.180657 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 4136
I20260809 00:46:19.187773 4875 tablet_replica.cc:330] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: stopping tablet replica
I20260809 00:46:19.188249 4875 raft_consensus.cc:2229] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:19.190389 4875 raft_consensus.cc:2258] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:19.193430 4875 ts_tablet_manager.cc:1905] T e8900f6600fb4ddb9c47772e9fbcbf88 P e18d457d0503406aa9088597f4eb362d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:19.195152 4876 tablet_replica.cc:330] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: stopping tablet replica
I20260809 00:46:19.195637 4876 raft_consensus.cc:2229] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:19.196185 4876 raft_consensus.cc:2258] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:19.196709 4873 tablet_replica.cc:330] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: stopping tablet replica
I20260809 00:46:19.197165 4873 raft_consensus.cc:2229] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:19.197292 4827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.182795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42970 (local address 127.28.92.129:41067)
0809 00:46:19.182969 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:19.182977 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:19.194360 (+ 11383us) server_negotiation.cc:407] Connection header received
0809 00:46:19.194883 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:19.194888 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:19.194955 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:19.195034 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:19.196432 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:19.196438 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:19.196443 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:19.196464 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:19.196503 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:19.196524 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:19.196657 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:19.196910 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 00:46:19.196990 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:46:19.198145 4873 raft_consensus.cc:2258] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:19.198348 4345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:19.200294 4876 ts_tablet_manager.cc:1905] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:19.200294 4873 ts_tablet_manager.cc:1905] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:19.207355 4876 ts_tablet_manager.cc:1918] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:19.207547 4876 log.cc:1196] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/e8900f6600fb4ddb9c47772e9fbcbf88
I20260809 00:46:19.207912 4873 ts_tablet_manager.cc:1918] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:19.208086 4873 log.cc:1196] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/e8900f6600fb4ddb9c47772e9fbcbf88
I20260809 00:46:19.208120 4876 ts_tablet_manager.cc:1939] T e8900f6600fb4ddb9c47772e9fbcbf88 P 2332d70d6a58435ea2b529337b45acc8: Deleting consensus metadata
I20260809 00:46:19.208595 4873 ts_tablet_manager.cc:1939] T e8900f6600fb4ddb9c47772e9fbcbf88 P 6a3a471835c64df4b1926faa14d1253f: Deleting consensus metadata
I20260809 00:46:19.210259 3999 catalog_manager.cc:4841] TS 2332d70d6a58435ea2b529337b45acc8 (127.28.92.130:39003): tablet e8900f6600fb4ddb9c47772e9fbcbf88 (table test-table [id=04bb81ae0b43442a9cc8a8ef14cd1665]) successfully deleted
I20260809 00:46:19.210405 4002 catalog_manager.cc:4841] TS 6a3a471835c64df4b1926faa14d1253f (127.28.92.131:44371): tablet e8900f6600fb4ddb9c47772e9fbcbf88 (table test-table [id=04bb81ae0b43442a9cc8a8ef14cd1665]) successfully deleted
W20260809 00:46:19.211308 3999 catalog_manager.cc:4808] TS 2332d70d6a58435ea2b529337b45acc8 (127.28.92.130:39003): delete failed for tablet e8900f6600fb4ddb9c47772e9fbcbf88 because the tablet was not found. No further retry: Not found: Tablet not found: e8900f6600fb4ddb9c47772e9fbcbf88
I20260809 00:46:19.294296 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 4136
W20260809 00:46:19.316776 4002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:41067 (error 108)
I20260809 00:46:19.316854 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 4359
I20260809 00:46:19.318768 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.318276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:42976)
0809 00:46:19.318457 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.318602 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 00:46:19.319051 4002 catalog_manager.cc:4584] TS e18d457d0503406aa9088597f4eb362d (127.28.92.129:41067): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8900f6600fb4ddb9c47772e9fbcbf88: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
I20260809 00:46:19.319861 4823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.317712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47532 (local address 127.28.92.130:39003)
0809 00:46:19.317911 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:19.317916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:19.317934 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:46:19.318085 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:19.318091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:19.318208 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:19.318312 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:19.319302 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:19.319308 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:19.319312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:19.319328 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:19.319360 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:19.319372 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:19.319479 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:19.319568 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 00:46:19.319613 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 00:46:19.320538 4569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:19.372807 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.372351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:42986)
0809 00:46:19.372555 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.372666 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 00:46:19.373826 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.373469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:42994)
0809 00:46:19.373587 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.373690 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 00:46:19.407955 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 4359
I20260809 00:46:19.431807 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 4589
I20260809 00:46:19.434556 4821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.432589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.28.92.131:44371)
0809 00:46:19.432778 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:19.432783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:19.432803 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:46:19.432940 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:19.432944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:19.433028 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:19.433110 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:19.433916 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:19.433922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:19.433926 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:19.433945 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:19.433986 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:19.434001 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:19.434140 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:19.434188 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 00:46:19.434249 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:46:19.434702 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.434266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:43006)
0809 00:46:19.434430 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.434539 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 00:46:19.435298 4792 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:19.435871 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.435460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:43010)
0809 00:46:19.435633 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.435735 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 00:46:19.516767 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.516206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:43016)
0809 00:46:19.516501 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.516600 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 00:46:19.517874 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:19.517457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41067 (local address 127.0.0.1:43026)
0809 00:46:19.517645 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:19.517757 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:41067: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260809 00:46:19.521885 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 4589
I20260809 00:46:19.545368 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 3979
I20260809 00:46:19.546589 4089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:19.651473 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 3979
2026-08-09T00:46:19Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2748 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 00:46:19.697466 29042 mini_oidc.cc:152] Starting JWKS server
I20260809 00:46:19.700611 29042 webserver.cc:460] Webserver started at https://127.0.0.1:40231/ using document root <none> and password file <none>
I20260809 00:46:19.701001 29042 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 00:46:19.701674 29042 webserver.cc:460] Webserver started at http://127.0.0.1:33187/ using document root <none> and password file <none>
2026-08-09T00:46:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:19Z Disabled control of system clock
I20260809 00:46:19.734429 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:46845
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:39779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:46845
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40231/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/testchainca.cert with env {}
W20260809 00:46:20.058547 4895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:20.058892 4895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:20.059029 4895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:20.066273 4895 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:20.066411 4895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:20.066483 4895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:20.066563 4895 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:20.066624 4895 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 00:46:20.066713 4895 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 00:46:20.066771 4895 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40231/jwks.json
I20260809 00:46:20.076774 4895 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:46845
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:46845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40231/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:20.078322 4895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:20.079593 4895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:20.090775 4913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:20.090898 4905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:20.090826 4908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:20.091871 4895 server_base.cc:1034] running on GCE node
I20260809 00:46:20.092608 4895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:20.094007 4895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:20.095237 4895 hybrid_clock.cc:648] HybridClock initialized: now 1786236380095189 us; error 36 us; skew 500 ppm
I20260809 00:46:20.095620 4895 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:20.097812 4895 webserver.cc:460] Webserver started at http://127.28.92.190:42847/ using document root <none> and password file <none>
I20260809 00:46:20.098471 4895 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:20.098578 4895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:20.098882 4895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:20.101794 4895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f"
format_stamp: "Formatted at 2026-08-09 00:46:20 on dist-test-slave-t7g5"
server_key: "f2930fcb220112bc0180c0c382189df4"
server_key_iv: "a8916d10c3d5b728a77a591e923e018c"
server_key_version: "encryptionkey@0"
I20260809 00:46:20.102592 4895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f"
format_stamp: "Formatted at 2026-08-09 00:46:20 on dist-test-slave-t7g5"
server_key: "f2930fcb220112bc0180c0c382189df4"
server_key_iv: "a8916d10c3d5b728a77a591e923e018c"
server_key_version: "encryptionkey@0"
I20260809 00:46:20.107671 4895 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:20.111186 4924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:20.112501 4895 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:20.112684 4895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f"
format_stamp: "Formatted at 2026-08-09 00:46:20 on dist-test-slave-t7g5"
server_key: "f2930fcb220112bc0180c0c382189df4"
server_key_iv: "a8916d10c3d5b728a77a591e923e018c"
server_key_version: "encryptionkey@0"
I20260809 00:46:20.112897 4895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:20.158071 4895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:20.158972 4895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:20.159278 4895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:20.176219 4895 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:46845
I20260809 00:46:20.176240 5001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:46845 every 8 connection(s)
I20260809 00:46:20.177563 4895 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:20.181313 5002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:20.182858 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 4895
I20260809 00:46:20.183059 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:20.183672 29042 external_mini_cluster.cc:1428] Setting key d8b925e1082b38962baaeae9a832b7de
I20260809 00:46:20.194554 5002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f: Bootstrap starting.
I20260809 00:46:20.198990 5002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:20.199839 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:20.185596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50798 (local address 127.28.92.190:46845)
0809 00:46:20.186674 (+ 1078us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:20.186693 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:20.186740 (+ 47us) server_negotiation.cc:407] Connection header received
0809 00:46:20.188399 (+ 1659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:20.188422 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:20.188930 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:20.189323 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:20.190236 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.192206 (+ 1970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.194052 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.194956 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.195128 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:20.196841 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:20.196854 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:20.196874 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:20.197614 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:20.197744 (+ 130us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:20.197775 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:20.197887 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:20.198538 (+ 651us) server_negotiation.cc:299] Negotiation successful
0809 00:46:20.198808 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":374,"threads_started":1}
I20260809 00:46:20.200140 5002 log.cc:824] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:20.203349 5002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f: No bootstrap required, opened a new log
I20260809 00:46:20.204105 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:46:20.212015 5002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46845 } }
I20260809 00:46:20.212404 5002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:20.212491 5002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e8060aaaa194e6f9d3e7d0bf82b2f6f, State: Initialized, Role: FOLLOWER
I20260809 00:46:20.213018 5002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46845 } }
I20260809 00:46:20.213235 5002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:20.213340 5002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:20.213471 5002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:20.215905 5002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46845 } }
I20260809 00:46:20.216429 5002 leader_election.cc:302] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e8060aaaa194e6f9d3e7d0bf82b2f6f; no voters:
I20260809 00:46:20.217023 5002 leader_election.cc:288] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:20.217149 5009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:20.217969 5009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [term 1 LEADER]: Becoming Leader. State: Replica: 7e8060aaaa194e6f9d3e7d0bf82b2f6f, State: Running, Role: LEADER
I20260809 00:46:20.218501 5009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46845 } }
I20260809 00:46:20.219120 5002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:20.222366 5010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46845 } } }
I20260809 00:46:20.222821 5010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:20.223573 5024 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:20.223366 5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e8060aaaa194e6f9d3e7d0bf82b2f6f. Latest consensus state: current_term: 1 leader_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e8060aaaa194e6f9d3e7d0bf82b2f6f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46845 } } }
I20260809 00:46:20.224011 5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:20.228556 5024 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:20.237566 5024 catalog_manager.cc:1347] Generated new cluster ID: a96d145c39424d3482c0b988286b64d5
I20260809 00:46:20.237694 5024 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:20.250830 5024 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:20.252030 5024 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:20.257624 5024 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e8060aaaa194e6f9d3e7d0bf82b2f6f: Generated new TSK 0
I20260809 00:46:20.258394 5024 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 00:46:20.310674 5055 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 00:46:20.310911 5055 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 00:46:20.312852 5006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:20.280659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50800 (local address 127.28.92.190:46845)
0809 00:46:20.280881 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:20.280889 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:20.281368 (+ 479us) server_negotiation.cc:407] Connection header received
0809 00:46:20.281866 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:20.281871 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:20.281956 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:20.282081 (+ 125us) server_negotiation.cc:226] Negotiated authn=JWT
0809 00:46:20.282729 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.283462 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.285576 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.286088 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.286186 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:20.286832 (+ 646us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 00:46:20.312300 (+ 25468us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 00:46:20.312616 (+ 316us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50800: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 00:46:20.312973 5006 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50800: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 00:46:20.315150 5054 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:20.280551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:46845 (local address 127.0.0.1:50800)
0809 00:46:20.281247 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:20.281281 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:20.281478 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:20.282123 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:20.282128 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:20.282143 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0809 00:46:20.282561 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:20.282572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.283594 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.283599 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:20.285420 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:20.285435 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.286278 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.286286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:20.286477 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:20.286561 (+ 84us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 00:46:20.312624 (+ 26063us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 00:46:20.313009 (+ 385us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.92.190:46845: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":335,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.28.92.190:46845: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40231/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 00:46:20.317078 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 4895
I20260809 00:46:20.318192 4991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:20.420105 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 4895
2026-08-09T00:46:20Z chronyd exiting
I20260809 00:46:20.475238 29042 test_util.cc:175] -----------------------------------------------
I20260809 00:46:20.475421 29042 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786236336094448-29042-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (782 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 00:46:20.480782 29042 mini_oidc.cc:152] Starting JWKS server
I20260809 00:46:20.483047 29042 webserver.cc:460] Webserver started at https://127.0.0.1:35955/ using document root <none> and password file <none>
I20260809 00:46:20.483349 29042 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 00:46:20.484069 29042 webserver.cc:460] Webserver started at http://127.0.0.1:39947/ using document root <none> and password file <none>
2026-08-09T00:46:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:20Z Disabled control of system clock
I20260809 00:46:20.517234 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34895
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:34271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34895
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35955/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/testchainca.cert with env {}
W20260809 00:46:20.837393 5066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:20.837757 5066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:20.837900 5066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:20.845034 5066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:20.845160 5066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:20.845224 5066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:20.845315 5066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:20.845377 5066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 00:46:20.845465 5066 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 00:46:20.845518 5066 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35955/jwks.json
I20260809 00:46:20.855545 5066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34895
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35955/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:20.856891 5066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:20.858256 5066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:20.869364 5076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:20.869464 5079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:20.869506 5077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:20.870767 5066 server_base.cc:1034] running on GCE node
I20260809 00:46:20.871567 5066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:20.872925 5066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:20.874141 5066 hybrid_clock.cc:648] HybridClock initialized: now 1786236380874088 us; error 31 us; skew 500 ppm
I20260809 00:46:20.874483 5066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:20.880442 5066 webserver.cc:460] Webserver started at http://127.28.92.190:46673/ using document root <none> and password file <none>
I20260809 00:46:20.881173 5066 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:20.881281 5066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:20.881608 5066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:20.884655 5066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "c81a1009f27c4f5b973e9d490b29df2f"
format_stamp: "Formatted at 2026-08-09 00:46:20 on dist-test-slave-t7g5"
server_key: "86e9e8259b3c21e647b0536d6a9bd0c5"
server_key_iv: "869efe5773ff320870cf38debcbd9f99"
server_key_version: "encryptionkey@0"
I20260809 00:46:20.885480 5066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "c81a1009f27c4f5b973e9d490b29df2f"
format_stamp: "Formatted at 2026-08-09 00:46:20 on dist-test-slave-t7g5"
server_key: "86e9e8259b3c21e647b0536d6a9bd0c5"
server_key_iv: "869efe5773ff320870cf38debcbd9f99"
server_key_version: "encryptionkey@0"
I20260809 00:46:20.890763 5066 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 00:46:20.894222 5088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:20.895695 5066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 00:46:20.895915 5066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "c81a1009f27c4f5b973e9d490b29df2f"
format_stamp: "Formatted at 2026-08-09 00:46:20 on dist-test-slave-t7g5"
server_key: "86e9e8259b3c21e647b0536d6a9bd0c5"
server_key_iv: "869efe5773ff320870cf38debcbd9f99"
server_key_version: "encryptionkey@0"
I20260809 00:46:20.896160 5066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:20.910661 5066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:20.911535 5066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:20.911866 5066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:20.930596 5066 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34895
I20260809 00:46:20.930603 5163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34895 every 8 connection(s)
I20260809 00:46:20.932154 5066 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:20.935878 5164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:20.936551 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 5066
I20260809 00:46:20.936756 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:20.937593 29042 external_mini_cluster.cc:1428] Setting key acc3c20fb1160bcc6d9a794740b1faef
I20260809 00:46:20.949875 5164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f: Bootstrap starting.
I20260809 00:46:20.951311 5167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:20.939613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56536 (local address 127.28.92.190:34895)
0809 00:46:20.940647 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:20.940659 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:20.940708 (+ 49us) server_negotiation.cc:407] Connection header received
0809 00:46:20.942479 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:20.942503 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:20.942985 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:20.943322 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:20.943857 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.945125 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.946918 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:20.947629 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:20.947760 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:20.949033 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:20.949041 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:20.949054 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:20.949570 (+ 516us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:20.949688 (+ 118us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:20.949716 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:20.949802 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:20.950062 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 00:46:20.950378 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":378,"threads_started":1}
I20260809 00:46:20.953131 5164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:20.954378 5164 log.cc:824] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:20.954907 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:46:20.957141 5164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f: No bootstrap required, opened a new log
I20260809 00:46:20.964473 5164 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81a1009f27c4f5b973e9d490b29df2f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34895 } }
I20260809 00:46:20.964884 5164 raft_consensus.cc:374] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:20.964985 5164 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81a1009f27c4f5b973e9d490b29df2f, State: Initialized, Role: FOLLOWER
I20260809 00:46:20.965554 5164 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81a1009f27c4f5b973e9d490b29df2f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34895 } }
I20260809 00:46:20.965871 5164 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:20.966001 5164 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:20.966154 5164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:20.968539 5164 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81a1009f27c4f5b973e9d490b29df2f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34895 } }
I20260809 00:46:20.969059 5164 leader_election.cc:302] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81a1009f27c4f5b973e9d490b29df2f; no voters:
I20260809 00:46:20.969635 5164 leader_election.cc:288] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:20.969811 5170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:20.970566 5170 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [term 1 LEADER]: Becoming Leader. State: Replica: c81a1009f27c4f5b973e9d490b29df2f, State: Running, Role: LEADER
I20260809 00:46:20.971079 5170 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81a1009f27c4f5b973e9d490b29df2f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34895 } }
I20260809 00:46:20.971673 5164 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:20.973692 5173 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81a1009f27c4f5b973e9d490b29df2f. Latest consensus state: current_term: 1 leader_uuid: "c81a1009f27c4f5b973e9d490b29df2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81a1009f27c4f5b973e9d490b29df2f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34895 } } }
I20260809 00:46:20.973853 5172 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c81a1009f27c4f5b973e9d490b29df2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81a1009f27c4f5b973e9d490b29df2f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34895 } } }
I20260809 00:46:20.974117 5173 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:20.974135 5172 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:20.976847 5181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:20.981426 5181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:20.989845 5181 catalog_manager.cc:1347] Generated new cluster ID: 05f792cf482040dda19e19936c15e97a
I20260809 00:46:20.989965 5181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:21.020541 5181 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:21.022495 5181 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:21.030735 5181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c81a1009f27c4f5b973e9d490b29df2f: Generated new TSK 0
I20260809 00:46:21.031843 5181 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 00:46:21.072232 5211 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 00:46:21.072371 5211 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 00:46:21.073525 5167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:21.045958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56552 (local address 127.28.92.190:34895)
0809 00:46:21.046175 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:21.046187 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:21.046662 (+ 475us) server_negotiation.cc:407] Connection header received
0809 00:46:21.046887 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:21.046891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:21.046977 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:21.047105 (+ 128us) server_negotiation.cc:226] Negotiated authn=JWT
0809 00:46:21.047663 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.048420 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.050356 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.050789 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.050881 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:21.051444 (+ 563us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 00:46:21.072880 (+ 21436us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 00:46:21.073267 (+ 387us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56552: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 00:46:21.073675 5167 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56552: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 00:46:21.073907 5210 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:21.045927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34895 (local address 127.0.0.1:56552)
0809 00:46:21.046545 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:21.046570 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:21.046728 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:21.047144 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:21.047150 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:21.047162 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0809 00:46:21.047496 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:21.047508 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.048559 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.048566 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:21.050219 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:21.050234 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.050956 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.050963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:21.051156 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:21.051205 (+ 49us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 00:46:21.073151 (+ 21946us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 00:46:21.073457 (+ 306us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.92.190:34895: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35955/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":314,"threads_started":1}
I20260809 00:46:21.075582 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 5066
I20260809 00:46:21.076829 5159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:21.168615 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 5066
2026-08-09T00:46:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (748 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 00:46:21.228291 29042 mini_oidc.cc:152] Starting JWKS server
I20260809 00:46:21.230223 29042 webserver.cc:460] Webserver started at https://127.0.0.1:39657/ using document root <none> and password file <none>
I20260809 00:46:21.230424 29042 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 00:46:21.230990 29042 webserver.cc:460] Webserver started at http://127.0.0.1:40801/ using document root <none> and password file <none>
2026-08-09T00:46:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:21Z Disabled control of system clock
I20260809 00:46:21.263151 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:44491
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:41411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:44491
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39657/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 00:46:21.588975 5220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:21.589311 5220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:21.589442 5220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:21.596726 5220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:21.596863 5220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:21.596933 5220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:21.597023 5220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:21.597087 5220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 00:46:21.597173 5220 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 00:46:21.597229 5220 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39657/jwks.json
I20260809 00:46:21.606509 5220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:44491
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:44491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39657/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:21.607899 5220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:21.609782 5220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:21.621563 5228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:21.621548 5230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:21.621563 5233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:21.622392 5220 server_base.cc:1034] running on GCE node
I20260809 00:46:21.623221 5220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:21.624607 5220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:21.625797 5220 hybrid_clock.cc:648] HybridClock initialized: now 1786236381625750 us; error 36 us; skew 500 ppm
I20260809 00:46:21.626150 5220 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:21.628357 5220 webserver.cc:460] Webserver started at http://127.28.92.190:40311/ using document root <none> and password file <none>
I20260809 00:46:21.629050 5220 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:21.629158 5220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:21.629468 5220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:21.632517 5220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "e963701dfe60494a8ffee3500b713592"
format_stamp: "Formatted at 2026-08-09 00:46:21 on dist-test-slave-t7g5"
server_key: "5b0c079c2d82a3ff3bd1ab56e9d9a8b7"
server_key_iv: "7ffcdf4b2996b167150897f1b24cec03"
server_key_version: "encryptionkey@0"
I20260809 00:46:21.633301 5220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "e963701dfe60494a8ffee3500b713592"
format_stamp: "Formatted at 2026-08-09 00:46:21 on dist-test-slave-t7g5"
server_key: "5b0c079c2d82a3ff3bd1ab56e9d9a8b7"
server_key_iv: "7ffcdf4b2996b167150897f1b24cec03"
server_key_version: "encryptionkey@0"
I20260809 00:46:21.638432 5220 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:46:21.641718 5242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:21.642999 5220 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:46:21.643165 5220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "e963701dfe60494a8ffee3500b713592"
format_stamp: "Formatted at 2026-08-09 00:46:21 on dist-test-slave-t7g5"
server_key: "5b0c079c2d82a3ff3bd1ab56e9d9a8b7"
server_key_iv: "7ffcdf4b2996b167150897f1b24cec03"
server_key_version: "encryptionkey@0"
I20260809 00:46:21.643358 5220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:21.661804 5220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:21.662665 5220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:21.662982 5220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:21.679831 5220 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:44491
I20260809 00:46:21.679865 5328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:44491 every 8 connection(s)
I20260809 00:46:21.681303 5220 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:21.681986 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 5220
I20260809 00:46:21.682214 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:21.682900 29042 external_mini_cluster.cc:1428] Setting key 71262db607a889d511fb817cc3f3829d
I20260809 00:46:21.685911 5330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:21.696326 5337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:21.684789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56940 (local address 127.28.92.190:44491)
0809 00:46:21.685813 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:21.685832 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:21.685875 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:46:21.687446 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:21.687468 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:21.687899 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:21.688253 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:21.688830 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.690651 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.691982 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.692648 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.692813 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:21.693990 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:21.694001 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:21.694016 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:21.694595 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:21.694669 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:21.694694 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:21.694809 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:21.695053 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 00:46:21.695359 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":345,"threads_started":1}
I20260809 00:46:21.697165 5330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592: Bootstrap starting.
I20260809 00:46:21.700445 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:46:21.700904 5330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:21.701987 5330 log.cc:824] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:21.705006 5330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592: No bootstrap required, opened a new log
I20260809 00:46:21.712419 5330 raft_consensus.cc:348] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e963701dfe60494a8ffee3500b713592" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44491 } }
I20260809 00:46:21.712888 5330 raft_consensus.cc:374] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:21.713022 5330 raft_consensus.cc:729] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e963701dfe60494a8ffee3500b713592, State: Initialized, Role: FOLLOWER
I20260809 00:46:21.713591 5330 consensus_queue.cc:260] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e963701dfe60494a8ffee3500b713592" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44491 } }
I20260809 00:46:21.713857 5330 raft_consensus.cc:388] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:21.713999 5330 raft_consensus.cc:482] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:21.714167 5330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:21.716323 5330 raft_consensus.cc:504] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e963701dfe60494a8ffee3500b713592" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44491 } }
I20260809 00:46:21.716838 5330 leader_election.cc:302] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e963701dfe60494a8ffee3500b713592; no voters:
I20260809 00:46:21.717413 5330 leader_election.cc:288] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:21.717561 5340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:21.718253 5340 raft_consensus.cc:686] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [term 1 LEADER]: Becoming Leader. State: Replica: e963701dfe60494a8ffee3500b713592, State: Running, Role: LEADER
I20260809 00:46:21.718806 5340 consensus_queue.cc:237] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e963701dfe60494a8ffee3500b713592" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44491 } }
I20260809 00:46:21.719518 5330 sys_catalog.cc:564] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:21.722100 5345 sys_catalog.cc:455] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e963701dfe60494a8ffee3500b713592. Latest consensus state: current_term: 1 leader_uuid: "e963701dfe60494a8ffee3500b713592" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e963701dfe60494a8ffee3500b713592" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44491 } } }
I20260809 00:46:21.722500 5345 sys_catalog.cc:458] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:21.723232 5342 sys_catalog.cc:455] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e963701dfe60494a8ffee3500b713592" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e963701dfe60494a8ffee3500b713592" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44491 } } }
I20260809 00:46:21.723651 5342 sys_catalog.cc:458] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:21.724175 5354 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:21.729339 5354 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:21.737219 5354 catalog_manager.cc:1347] Generated new cluster ID: 7f1a1c4807a04e198c954f79ab1f580d
I20260809 00:46:21.737327 5354 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:21.753710 5354 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:21.755669 5354 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:21.770459 5354 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e963701dfe60494a8ffee3500b713592: Generated new TSK 0
I20260809 00:46:21.771589 5354 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:46:21.798486 5337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:21.789922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56948 (local address 127.28.92.190:44491)
0809 00:46:21.790124 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:21.790131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:21.790590 (+ 459us) server_negotiation.cc:407] Connection header received
0809 00:46:21.790827 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:21.790834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:21.790937 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:21.791113 (+ 176us) server_negotiation.cc:226] Negotiated authn=JWT
0809 00:46:21.791539 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.792682 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.794031 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.794715 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.794844 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:21.795349 (+ 505us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 00:46:21.797801 (+ 2452us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39657/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 00:46:21.798155 (+ 354us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56948: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39657/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":64}
W20260809 00:46:21.798632 5337 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56948: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39657/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 00:46:21.800123 5384 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:21.789871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44491 (local address 127.0.0.1:56948)
0809 00:46:21.790488 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:21.790506 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:21.790629 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:21.791108 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:21.791111 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:21.791121 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0809 00:46:21.791387 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:21.791395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.792793 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.792796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:21.793887 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:21.793900 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:21.794886 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:21.794890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:21.795018 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:21.795050 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 00:46:21.798018 (+ 2968us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39657/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 00:46:21.799711 (+ 1693us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.92.190:44491: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39657/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":1407,"thread_start_us":335,"threads_started":1}
I20260809 00:46:21.801293 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 5220
I20260809 00:46:21.802556 5322 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 00:46:21.810014 5385 webserver.cc:533] Webserver: sslize failed:
E20260809 00:46:21.810114 5385 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 00:46:21.894124 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 5220
2026-08-09T00:46:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (728 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T00:46:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:21Z Disabled control of system clock
I20260809 00:46:21.988664 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34473
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:41517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34473
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/testchainca.cert with env {}
W20260809 00:46:22.322455 5390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:22.322764 5390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:22.322890 5390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:22.330180 5390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:22.330298 5390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:22.330363 5390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:22.330449 5390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:22.330509 5390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 00:46:22.330598 5390 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 00:46:22.330650 5390 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 00:46:22.340646 5390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34473
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:22.342005 5390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:22.343294 5390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:22.354486 5401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:22.354584 5402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:22.354530 5406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:22.355594 5390 server_base.cc:1034] running on GCE node
I20260809 00:46:22.356376 5390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:22.357719 5390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:22.358919 5390 hybrid_clock.cc:648] HybridClock initialized: now 1786236382358862 us; error 51 us; skew 500 ppm
I20260809 00:46:22.359264 5390 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:46:22.361361 5390 webserver.cc:460] Webserver started at http://127.28.92.190:42017/ using document root <none> and password file <none>
I20260809 00:46:22.362082 5390 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:22.362185 5390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:22.362476 5390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:22.365242 5390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "da7f6444dbdc47c4a5c8438a2f8aa272"
format_stamp: "Formatted at 2026-08-09 00:46:22 on dist-test-slave-t7g5"
server_key: "0b181d833e049e5add4121be35c00f0a"
server_key_iv: "d2f901b74cf981ce3dbe2d5600872a8e"
server_key_version: "encryptionkey@0"
I20260809 00:46:22.366072 5390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "da7f6444dbdc47c4a5c8438a2f8aa272"
format_stamp: "Formatted at 2026-08-09 00:46:22 on dist-test-slave-t7g5"
server_key: "0b181d833e049e5add4121be35c00f0a"
server_key_iv: "d2f901b74cf981ce3dbe2d5600872a8e"
server_key_version: "encryptionkey@0"
I20260809 00:46:22.371057 5390 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 00:46:22.374346 5414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:22.375677 5390 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:46:22.375838 5390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "da7f6444dbdc47c4a5c8438a2f8aa272"
format_stamp: "Formatted at 2026-08-09 00:46:22 on dist-test-slave-t7g5"
server_key: "0b181d833e049e5add4121be35c00f0a"
server_key_iv: "d2f901b74cf981ce3dbe2d5600872a8e"
server_key_version: "encryptionkey@0"
I20260809 00:46:22.376047 5390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:22.405920 5390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:22.406803 5390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:22.407090 5390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:22.424549 5390 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34473
I20260809 00:46:22.424576 5509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34473 every 8 connection(s)
I20260809 00:46:22.425884 5390 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:22.429489 5510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:22.430569 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 5390
I20260809 00:46:22.430729 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:22.431370 29042 external_mini_cluster.cc:1428] Setting key 213237a9142eb470f76b0b941fea2520
I20260809 00:46:22.442611 5510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272: Bootstrap starting.
I20260809 00:46:22.444612 5514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:22.433271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55730 (local address 127.28.92.190:34473)
0809 00:46:22.434311 (+ 1040us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:22.434321 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:22.434360 (+ 39us) server_negotiation.cc:407] Connection header received
0809 00:46:22.435935 (+ 1575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:22.435969 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:22.436408 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:22.436700 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:22.437324 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:22.438659 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:22.440405 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:22.441054 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:22.441182 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:22.442379 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:22.442388 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:22.442403 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:46:22.442961 (+ 558us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:22.443043 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:46:22.443064 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:22.443150 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:22.443374 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 00:46:22.443674 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":381,"threads_started":1}
I20260809 00:46:22.446051 5510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:22.447160 5510 log.cc:824] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:22.448333 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:46:22.449944 5510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272: No bootstrap required, opened a new log
I20260809 00:46:22.456868 5510 raft_consensus.cc:348] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34473 } }
I20260809 00:46:22.457194 5510 raft_consensus.cc:374] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:22.457295 5510 raft_consensus.cc:729] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da7f6444dbdc47c4a5c8438a2f8aa272, State: Initialized, Role: FOLLOWER
I20260809 00:46:22.457882 5510 consensus_queue.cc:260] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34473 } }
I20260809 00:46:22.458096 5510 raft_consensus.cc:388] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:22.458225 5510 raft_consensus.cc:482] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:22.458375 5510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:22.460474 5510 raft_consensus.cc:504] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34473 } }
I20260809 00:46:22.460938 5510 leader_election.cc:302] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da7f6444dbdc47c4a5c8438a2f8aa272; no voters:
I20260809 00:46:22.461474 5510 leader_election.cc:288] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:22.461588 5519 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:22.462276 5519 raft_consensus.cc:686] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [term 1 LEADER]: Becoming Leader. State: Replica: da7f6444dbdc47c4a5c8438a2f8aa272, State: Running, Role: LEADER
I20260809 00:46:22.462817 5519 consensus_queue.cc:237] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34473 } }
I20260809 00:46:22.463482 5510 sys_catalog.cc:564] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:22.465392 5520 sys_catalog.cc:455] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34473 } } }
I20260809 00:46:22.465360 5521 sys_catalog.cc:455] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da7f6444dbdc47c4a5c8438a2f8aa272. Latest consensus state: current_term: 1 leader_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7f6444dbdc47c4a5c8438a2f8aa272" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34473 } } }
I20260809 00:46:22.465857 5520 sys_catalog.cc:458] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:22.465950 5521 sys_catalog.cc:458] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:22.469610 5531 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:22.474313 5531 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:22.482915 5531 catalog_manager.cc:1347] Generated new cluster ID: 0a6af4e30f8d4d539edda1ce7a69917e
I20260809 00:46:22.483042 5531 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:22.504446 5531 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:22.506507 5531 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:22.534965 5531 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da7f6444dbdc47c4a5c8438a2f8aa272: Generated new TSK 0
I20260809 00:46:22.536069 5531 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:46:22.659497 5514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:22.559799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55740 (local address 127.28.92.190:34473)
0809 00:46:22.559991 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:22.559997 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:22.560326 (+ 329us) server_negotiation.cc:407] Connection header received
0809 00:46:22.560530 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:22.560536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:22.560626 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:22.560799 (+ 173us) server_negotiation.cc:226] Negotiated authn=JWT
0809 00:46:22.561181 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:22.562345 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:22.563665 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:22.564387 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:22.564535 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:22.565113 (+ 578us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 00:46:22.658623 (+ 93510us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 00:46:22.659122 (+ 499us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55740: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 00:46:22.659703 5560 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:22.559663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34473 (local address 127.0.0.1:55740)
0809 00:46:22.560234 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:22.560250 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:22.560365 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:22.560802 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:22.560805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:22.560814 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0809 00:46:22.561049 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:22.561057 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:22.562483 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:22.562486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:22.563531 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:22.563543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:22.564562 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:22.564567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:22.564774 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:22.564812 (+ 38us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 00:46:22.658938 (+ 94126us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 00:46:22.659275 (+ 337us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.28.92.190:34473: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":305,"threads_started":1}
W20260809 00:46:22.659868 5514 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55740: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
I20260809 00:46:22.660661 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 5390
I20260809 00:46:22.661851 5500 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:22.765359 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 5390
2026-08-09T00:46:22Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (847 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (1548 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (447 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:24 dist-test-slave-t7g5 krb5kdc[5594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:24 dist-test-slave-t7g5 krb5kdc[5594](info): set up 2 sockets
Aug 09 00:46:24 dist-test-slave-t7g5 krb5kdc[5594](info): commencing operation
krb5kdc: starting...
W20260809 00:46:25.966957 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.003s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:26 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:26.191745 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:40305
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:40305
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:26.517324 5618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:26.517637 5618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:26.517787 5618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:26.525002 5618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:26.525118 5618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:26.525173 5618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:26.525231 5618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:26.525276 5618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:26.535332 5618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:40305
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:40305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:26.536682 5618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:26.537994 5618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:26.549408 5628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:26.549431 5630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:26.549590 5634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:26.550312 5618 server_base.cc:1034] running on GCE node
I20260809 00:46:26.551061 5618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:26.552350 5618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:26.553542 5618 hybrid_clock.cc:648] HybridClock initialized: now 1786236386553487 us; error 44 us; skew 500 ppm
I20260809 00:46:26.553865 5618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:26 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236386, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:26.560853 5618 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:26.562321 5618 webserver.cc:460] Webserver started at http://127.28.92.190:37661/ using document root <none> and password file <none>
I20260809 00:46:26.562985 5618 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:26.563099 5618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:26.563405 5618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:26.566398 5618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "b96294b6976f40f5ba10f2729f5314ce"
format_stamp: "Formatted at 2026-08-09 00:46:26 on dist-test-slave-t7g5"
server_key: "c0990a822b39c97f1a4c312de01739d9"
server_key_iv: "2281af9a6891a4df16149eb5537d5c28"
server_key_version: "encryptionkey@0"
I20260809 00:46:26.567337 5618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "b96294b6976f40f5ba10f2729f5314ce"
format_stamp: "Formatted at 2026-08-09 00:46:26 on dist-test-slave-t7g5"
server_key: "c0990a822b39c97f1a4c312de01739d9"
server_key_iv: "2281af9a6891a4df16149eb5537d5c28"
server_key_version: "encryptionkey@0"
I20260809 00:46:26.572500 5618 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:26.575822 5645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:26.577078 5618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 00:46:26.577227 5618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "b96294b6976f40f5ba10f2729f5314ce"
format_stamp: "Formatted at 2026-08-09 00:46:26 on dist-test-slave-t7g5"
server_key: "c0990a822b39c97f1a4c312de01739d9"
server_key_iv: "2281af9a6891a4df16149eb5537d5c28"
server_key_version: "encryptionkey@0"
I20260809 00:46:26.577405 5618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:26.594604 5618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:26.598394 5618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:26.598649 5618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:26.615564 5618 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:40305
I20260809 00:46:26.615593 5748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:40305 every 8 connection(s)
I20260809 00:46:26.616910 5618 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:26.620498 5749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:26.621626 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 5618
I20260809 00:46:26.621865 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:26.622484 29042 external_mini_cluster.cc:1428] Setting key eab320a80113e35530661b07ca3d13f3
I20260809 00:46:26.633984 5749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce: Bootstrap starting.
Aug 09 00:46:26 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:26.637735 5749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:26.638890 5749 log.cc:824] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:26.641992 5749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce: No bootstrap required, opened a new log
I20260809 00:46:26.644876 5756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:26.624325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42990 (local address 127.28.92.190:40305)
0809 00:46:26.625111 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:26.625122 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:26.625170 (+ 48us) server_negotiation.cc:407] Connection header received
0809 00:46:26.626786 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:26.626808 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:26.627185 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:26.627500 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:26.629198 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:26.630518 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:26.632229 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:26.632853 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:26.632969 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:26.637683 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:26.637694 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:26.637709 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:26.637752 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:26.640962 (+ 3210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:26.641758 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:26.641765 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:26.641771 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:26.641935 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:26.642344 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:26.642347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:26.642349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:26.642838 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:26.643047 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:26.643514 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 00:46:26.643858 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":359,"threads_started":1}
I20260809 00:46:26.649963 5749 raft_consensus.cc:348] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96294b6976f40f5ba10f2729f5314ce" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40305 } }
I20260809 00:46:26.650302 5749 raft_consensus.cc:374] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:26.650399 5749 raft_consensus.cc:729] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b96294b6976f40f5ba10f2729f5314ce, State: Initialized, Role: FOLLOWER
I20260809 00:46:26.650955 5749 consensus_queue.cc:260] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96294b6976f40f5ba10f2729f5314ce" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40305 } }
I20260809 00:46:26.651175 5749 raft_consensus.cc:388] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:26.651304 5749 raft_consensus.cc:482] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:26.651446 5749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:26.653486 5749 raft_consensus.cc:504] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96294b6976f40f5ba10f2729f5314ce" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40305 } }
I20260809 00:46:26.653967 5749 leader_election.cc:302] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b96294b6976f40f5ba10f2729f5314ce; no voters:
I20260809 00:46:26.654516 5749 leader_election.cc:288] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:26.654623 5762 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:26.655233 5762 raft_consensus.cc:686] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [term 1 LEADER]: Becoming Leader. State: Replica: b96294b6976f40f5ba10f2729f5314ce, State: Running, Role: LEADER
I20260809 00:46:26.655743 5762 consensus_queue.cc:237] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96294b6976f40f5ba10f2729f5314ce" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40305 } }
I20260809 00:46:26.656468 5749 sys_catalog.cc:564] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:26.658303 5764 sys_catalog.cc:455] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader b96294b6976f40f5ba10f2729f5314ce. Latest consensus state: current_term: 1 leader_uuid: "b96294b6976f40f5ba10f2729f5314ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96294b6976f40f5ba10f2729f5314ce" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40305 } } }
I20260809 00:46:26.658746 5764 sys_catalog.cc:458] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:26.659582 5774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:26.659472 5763 sys_catalog.cc:455] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b96294b6976f40f5ba10f2729f5314ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b96294b6976f40f5ba10f2729f5314ce" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40305 } } }
I20260809 00:46:26.659852 5763 sys_catalog.cc:458] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:26.664566 5774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:26.674296 5774 catalog_manager.cc:1347] Generated new cluster ID: 98918751967546fbb3bd644405d7b1d4
I20260809 00:46:26.674408 5774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:26.702132 5774 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:26.703383 5774 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:26.709205 5774 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b96294b6976f40f5ba10f2729f5314ce: Generated new TSK 0
I20260809 00:46:26.710181 5774 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:46:26.775514 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:40305
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:27.101531 5808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:27.101852 5808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:27.102017 5808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:27.109221 5808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:27.109333 5808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:27.109495 5808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:27.119236 5808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:40305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:27.120580 5808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:27.121932 5808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:27.134451 5814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:27.134510 5817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:27.134409 5815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:27.135553 5808 server_base.cc:1034] running on GCE node
I20260809 00:46:27.136128 5808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:27.137012 5808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:27.138201 5808 hybrid_clock.cc:648] HybridClock initialized: now 1786236387138159 us; error 37 us; skew 500 ppm
I20260809 00:46:27.138486 5808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:27 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236387, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:27.141460 5808 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:46:27.142848 5808 webserver.cc:460] Webserver started at http://127.28.92.129:45931/ using document root <none> and password file <none>
I20260809 00:46:27.143476 5808 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:27.143579 5808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:27.143827 5808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:27.147059 5808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "bd456edfd1f84beea51348c60cda35f8"
format_stamp: "Formatted at 2026-08-09 00:46:27 on dist-test-slave-t7g5"
server_key: "d3a364ec5368e77a587773b8c709fc6a"
server_key_iv: "b749cd29b371fdfa259675b292e51ccf"
server_key_version: "encryptionkey@0"
I20260809 00:46:27.147780 5808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "bd456edfd1f84beea51348c60cda35f8"
format_stamp: "Formatted at 2026-08-09 00:46:27 on dist-test-slave-t7g5"
server_key: "d3a364ec5368e77a587773b8c709fc6a"
server_key_iv: "b749cd29b371fdfa259675b292e51ccf"
server_key_version: "encryptionkey@0"
I20260809 00:46:27.152649 5808 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:46:27.156330 5830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:27.157794 5808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 00:46:27.157933 5808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "bd456edfd1f84beea51348c60cda35f8"
format_stamp: "Formatted at 2026-08-09 00:46:27 on dist-test-slave-t7g5"
server_key: "d3a364ec5368e77a587773b8c709fc6a"
server_key_iv: "b749cd29b371fdfa259675b292e51ccf"
server_key_version: "encryptionkey@0"
I20260809 00:46:27.158130 5808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:27.176601 5808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:27.180415 5808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:27.180761 5808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:27.181730 5808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:27.183024 5808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:27.183096 5808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:27.183189 5808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:27.183233 5808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:27.212714 5808 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:39683
I20260809 00:46:27.212756 6044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:39683 every 8 connection(s)
I20260809 00:46:27.214022 5808 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:27.219548 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 5808
I20260809 00:46:27.219733 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:27.220551 29042 external_mini_cluster.cc:1428] Setting key f9894ec67942cd50725d5992ed23d640
Aug 09 00:46:27 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236387, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:27.233721 6048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:27.216417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:41981 (local address 127.28.92.190:40305)
0809 00:46:27.216823 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:27.216828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:27.217743 (+ 915us) server_negotiation.cc:407] Connection header received
0809 00:46:27.219521 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:27.219527 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:27.219607 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:27.219714 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:27.221644 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.222465 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.223970 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.224359 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.224469 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:27.228072 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:27.228077 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:27.228080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:27.228113 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:27.230844 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:27.231503 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:27.231509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:27.231512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:27.231649 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:27.232014 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:27.232019 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:27.232022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:27.232355 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:27.232495 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:27.233128 (+ 633us) server_negotiation.cc:299] Negotiation successful
0809 00:46:27.233354 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":201,"threads_started":1}
I20260809 00:46:27.234498 6049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:27.216860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:40305 (local address 127.28.92.129:41981)
0809 00:46:27.217580 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:27.217619 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:27.219248 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:27.220050 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:27.220061 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:27.220815 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:27.221487 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:27.221506 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.222617 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.222621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:27.223821 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:27.223835 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.224591 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.224599 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:27.224820 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:27.225424 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:27.225460 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:27.227862 (+ 2402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:27.230977 (+ 3115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:27.230984 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:27.230996 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:27.231386 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:27.231739 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:27.231742 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:27.231744 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:27.231920 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:27.232463 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:27.232469 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:27.232760 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 00:46:27.232982 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 00:46:27.233356 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":268,"threads_started":1}
I20260809 00:46:27.235996 6045 heartbeater.cc:347] Connected to a master server at 127.28.92.190:40305
I20260809 00:46:27.236352 6045 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:27.237200 6045 heartbeater.cc:511] Master 127.28.92.190:40305 requested a full tablet report, sending...
I20260809 00:46:27.239392 5683 ts_manager.cc:194] Registered new tserver with Master: bd456edfd1f84beea51348c60cda35f8 (127.28.92.129:39683)
I20260809 00:46:27.240850 5683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:41981
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:46:27.272810 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:40305
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:27.598747 6055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:27.599036 6055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:27.599174 6055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:27.606280 6055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:27.606393 6055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:27.606549 6055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:27.616869 6055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:40305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:27.618482 6055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:27.620141 6055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:27.634728 6065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:27.634765 6066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:27.635093 6068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:27.635571 6055 server_base.cc:1034] running on GCE node
I20260809 00:46:27.636135 6055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:27.637014 6055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:27.638207 6055 hybrid_clock.cc:648] HybridClock initialized: now 1786236387638154 us; error 40 us; skew 500 ppm
I20260809 00:46:27.638509 6055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:27 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236387, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:27.641399 6055 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:46:27.642920 6055 webserver.cc:460] Webserver started at http://127.28.92.130:42635/ using document root <none> and password file <none>
I20260809 00:46:27.643581 6055 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:27.643699 6055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:27.643991 6055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:27.646872 6055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "5d469db2e9fc4bc185366c7f6a5d4c91"
format_stamp: "Formatted at 2026-08-09 00:46:27 on dist-test-slave-t7g5"
server_key: "9dedb7b95c66eb321dd2a70ed6e468b5"
server_key_iv: "8b7b556a7f0468dbdcd5dfd3ca0a382d"
server_key_version: "encryptionkey@0"
I20260809 00:46:27.647626 6055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "5d469db2e9fc4bc185366c7f6a5d4c91"
format_stamp: "Formatted at 2026-08-09 00:46:27 on dist-test-slave-t7g5"
server_key: "9dedb7b95c66eb321dd2a70ed6e468b5"
server_key_iv: "8b7b556a7f0468dbdcd5dfd3ca0a382d"
server_key_version: "encryptionkey@0"
I20260809 00:46:27.652462 6055 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 00:46:27.655751 6078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:27.657050 6055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:46:27.657197 6055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "5d469db2e9fc4bc185366c7f6a5d4c91"
format_stamp: "Formatted at 2026-08-09 00:46:27 on dist-test-slave-t7g5"
server_key: "9dedb7b95c66eb321dd2a70ed6e468b5"
server_key_iv: "8b7b556a7f0468dbdcd5dfd3ca0a382d"
server_key_version: "encryptionkey@0"
I20260809 00:46:27.657382 6055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:27.677577 6055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:27.681289 6055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:27.681555 6055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:27.682547 6055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:27.683815 6055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:27.683897 6055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:27.684017 6055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:27.684072 6055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:27.713338 6055 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:41835
I20260809 00:46:27.713394 6295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:41835 every 8 connection(s)
I20260809 00:46:27.714596 6055 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:27.723964 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 6055
I20260809 00:46:27.724149 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:27.724666 29042 external_mini_cluster.cc:1428] Setting key b7c79d93764cc11837f88d24fcce429f
Aug 09 00:46:27 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236387, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:27.734158 6048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:27.717080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:51363 (local address 127.28.92.190:40305)
0809 00:46:27.717286 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:27.717292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:27.718528 (+ 1236us) server_negotiation.cc:407] Connection header received
0809 00:46:27.720229 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:27.720233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:27.720311 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:27.720400 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:27.721873 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.722585 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.724345 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.724798 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.724909 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:27.728559 (+ 3650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:27.728564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:27.728568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:27.728601 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:27.731148 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:27.731875 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:27.731879 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:27.731881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:27.732021 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:27.732436 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:27.732440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:27.732442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:27.732711 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:27.732843 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:27.733544 (+ 701us) server_negotiation.cc:299] Negotiation successful
0809 00:46:27.733804 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:46:27.735352 6298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:27.717604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:40305 (local address 127.28.92.130:51363)
0809 00:46:27.718353 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:27.718392 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:27.719988 (+ 1596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:27.720602 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:27.720610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:27.721113 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:27.721705 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:27.721728 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.722697 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.722700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:27.724208 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:27.724225 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:27.725024 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:27.725032 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:27.725344 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:27.726048 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:27.726078 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:27.728328 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:27.731285 (+ 2957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:27.731296 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:27.731315 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:27.731749 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:27.732126 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:27.732131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:27.732135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:27.732322 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:27.732836 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:27.732845 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:27.733182 (+ 337us) client_negotiation.cc:769] Sending connection context
0809 00:46:27.733422 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 00:46:27.733992 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":273,"threads_started":1}
I20260809 00:46:27.736732 6296 heartbeater.cc:347] Connected to a master server at 127.28.92.190:40305
I20260809 00:46:27.737025 6296 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:27.737778 6296 heartbeater.cc:511] Master 127.28.92.190:40305 requested a full tablet report, sending...
I20260809 00:46:27.739166 5683 ts_manager.cc:194] Registered new tserver with Master: 5d469db2e9fc4bc185366c7f6a5d4c91 (127.28.92.130:41835)
I20260809 00:46:27.739943 5683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:51363
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:46:27.772585 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:40305
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:28.095594 6309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:28.095902 6309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:28.096005 6309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:28.103252 6309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:28.103394 6309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:28.103554 6309 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:28.113314 6309 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:40305
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:28.114639 6309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:28.115988 6309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:28.128773 6318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:28.128731 6315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:28.128818 6316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:28.135072 6309 server_base.cc:1034] running on GCE node
I20260809 00:46:28.135739 6309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:28.136704 6309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:28.137905 6309 hybrid_clock.cc:648] HybridClock initialized: now 1786236388137858 us; error 35 us; skew 500 ppm
I20260809 00:46:28.138217 6309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.141232 6309 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:46:28.142813 6309 webserver.cc:460] Webserver started at http://127.28.92.131:46587/ using document root <none> and password file <none>
I20260809 00:46:28.143508 6309 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:28.143625 6309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:28.143923 6309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:28.146819 6309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "51049c21ba0041d3888aca95c5e2a93a"
format_stamp: "Formatted at 2026-08-09 00:46:28 on dist-test-slave-t7g5"
server_key: "aa04110569fe7936738ceca7010d9799"
server_key_iv: "505a29cb1a829e1602409fc5d57ef355"
server_key_version: "encryptionkey@0"
I20260809 00:46:28.147660 6309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "51049c21ba0041d3888aca95c5e2a93a"
format_stamp: "Formatted at 2026-08-09 00:46:28 on dist-test-slave-t7g5"
server_key: "aa04110569fe7936738ceca7010d9799"
server_key_iv: "505a29cb1a829e1602409fc5d57ef355"
server_key_version: "encryptionkey@0"
I20260809 00:46:28.152608 6309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:46:28.155993 6328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:28.157382 6309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:46:28.157536 6309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "51049c21ba0041d3888aca95c5e2a93a"
format_stamp: "Formatted at 2026-08-09 00:46:28 on dist-test-slave-t7g5"
server_key: "aa04110569fe7936738ceca7010d9799"
server_key_iv: "505a29cb1a829e1602409fc5d57ef355"
server_key_version: "encryptionkey@0"
I20260809 00:46:28.157763 6309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:28.175109 6309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:28.178809 6309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:28.179071 6309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:28.179972 6309 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:28.181296 6309 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:28.181370 6309 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:28.181485 6309 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:28.181548 6309 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:28.212746 6309 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:38397
I20260809 00:46:28.212769 6533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:38397 every 8 connection(s)
I20260809 00:46:28.214062 6309 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:28.223280 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 6309
I20260809 00:46:28.223423 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:28.223829 29042 external_mini_cluster.cc:1428] Setting key 802e3b2f43d4531c59a6c68d2b27bdb3
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:28.232438 6048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.216725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:49521 (local address 127.28.92.190:40305)
0809 00:46:28.216933 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.216940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.218095 (+ 1155us) server_negotiation.cc:407] Connection header received
0809 00:46:28.219755 (+ 1660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.219760 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.219854 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.219940 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.221278 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.222066 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.223560 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.223971 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.224088 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.227570 (+ 3482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.227575 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.227578 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.227610 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.229973 (+ 2363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.230700 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.230703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.230705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.230819 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.231137 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.231139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.231141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.231382 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.231498 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.232045 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.232203 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:46:28.233343 6537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.217182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:40305 (local address 127.28.92.131:49521)
0809 00:46:28.217924 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:28.217971 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:28.219524 (+ 1553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:28.220129 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:28.220136 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:28.220626 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:28.221149 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:28.221166 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.222187 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.222190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:28.223436 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:28.223449 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.224185 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.224192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:28.224410 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.225070 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:28.225097 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:28.227370 (+ 2273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:28.230111 (+ 2741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:28.230119 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:28.230134 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:28.230616 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:28.230892 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:28.230894 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:28.230897 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:28.231065 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:28.231473 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:28.231478 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:28.231751 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 00:46:28.231961 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 00:46:28.232297 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":282,"threads_started":1}
I20260809 00:46:28.234618 6535 heartbeater.cc:347] Connected to a master server at 127.28.92.190:40305
I20260809 00:46:28.234889 6535 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:28.235579 6535 heartbeater.cc:511] Master 127.28.92.190:40305 requested a full tablet report, sending...
I20260809 00:46:28.236891 5683 ts_manager.cc:194] Registered new tserver with Master: 51049c21ba0041d3888aca95c5e2a93a (127.28.92.131:38397)
I20260809 00:46:28.237887 5683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:49521
I20260809 00:46:28.239001 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:46:28.244189 6045 heartbeater.cc:503] Master 127.28.92.190:40305 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/test-admin.keytab.
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.267280 29042 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 00:46:28.272066 6549 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:28.269770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35356 (local address 127.28.92.129:39683)
0809 00:46:28.270358 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.270366 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.270393 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:46:28.270525 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.270532 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.270746 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.270874 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.271707 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35356: BlockingRecv error: recv got EOF from 127.0.0.1:35356 (error 108)
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":281,"threads_started":1}
W20260809 00:46:28.272411 29042 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc' of type FILE
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.273885 29042 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.275149 29042 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:28.289294 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.276715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35364 (local address 127.28.92.129:39683)
0809 00:46:28.276893 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.276897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.276964 (+ 67us) server_negotiation.cc:407] Connection header received
0809 00:46:28.277097 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.277100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.277153 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.277226 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.278118 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.279066 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.280200 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.280759 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.280855 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.284168 (+ 3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.284179 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.284193 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.284223 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.286743 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.287368 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.287375 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.287378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.287504 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.287857 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.287860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.287862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.288194 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.288488 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.288767 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.289025 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 00:46:28.294835 6549 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:28.293123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.28.92.129:39683)
0809 00:46:28.293304 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.293311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.293574 (+ 263us) server_negotiation.cc:407] Connection header received
0809 00:46:28.293749 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.293755 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.293816 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.293894 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.294592 (+ 698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35370: BlockingRecv error: recv got EOF from 127.0.0.1:35370 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 00:46:28.294950 29042 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc' of type FILE
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.296365 29042 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.297581 29042 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:28.310817 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.298859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35374 (local address 127.28.92.129:39683)
0809 00:46:28.299034 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.299040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.299279 (+ 239us) server_negotiation.cc:407] Connection header received
0809 00:46:28.299422 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.299428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.299503 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.299582 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.300499 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.301180 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.302370 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.302816 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.302921 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.306235 (+ 3314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.306239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.306242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.306285 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.308433 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.309001 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.309006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.309010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.309134 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.309509 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.309514 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.309517 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.309820 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.310070 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.310335 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.310547 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 00:46:28.315032 6549 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:28.313313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35388 (local address 127.28.92.129:39683)
0809 00:46:28.313519 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.313526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.313771 (+ 245us) server_negotiation.cc:407] Connection header received
0809 00:46:28.313875 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.313878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.313955 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.314042 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.314787 (+ 745us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35388: BlockingRecv error: recv got EOF from 127.0.0.1:35388 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 00:46:28.315160 29042 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786236336094448-29042-0/krb5kdc/krb5cc' of type FILE
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.316522 29042 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:28.317701 29042 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:28.331247 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.318828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35404 (local address 127.28.92.129:39683)
0809 00:46:28.319000 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.319006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.319271 (+ 265us) server_negotiation.cc:407] Connection header received
0809 00:46:28.319396 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.319401 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.319455 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.319533 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.320403 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.321100 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.322322 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.322721 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.322826 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.326142 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.326147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.326150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.326179 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.328469 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.329122 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.329129 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.329133 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.329320 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.329751 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.329756 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.329758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.330141 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.330483 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.330658 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.330835 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 00:46:28.332942 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 5808
I20260809 00:46:28.343568 6549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.333623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.28.92.129:39683)
0809 00:46:28.333800 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.333804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.334136 (+ 332us) server_negotiation.cc:407] Connection header received
0809 00:46:28.334255 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.334259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.334310 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.334378 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.335179 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.335835 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.336997 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.337388 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.337484 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.339320 (+ 1836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.339324 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.339327 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.339352 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.341500 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.342083 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.342086 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.342088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.342218 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.342484 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.342487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.342489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.342721 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.342911 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.343158 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.343314 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:46:28.344098 6034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:28.425056 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 5808
I20260809 00:46:28.447638 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 6055
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:46:28.462572 6572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.448555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47692 (local address 127.28.92.130:41835)
0809 00:46:28.449110 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.449117 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.449142 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:46:28.449202 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.449209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.449409 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.449554 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.450498 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.451509 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.452658 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.453200 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.453293 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.457046 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.457060 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.457076 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.457118 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.459810 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.460495 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.460502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.460504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.460631 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.460898 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.460902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.460905 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.461362 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.461601 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.461990 (+ 389us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.462258 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":291,"threads_started":1}
I20260809 00:46:28.463833 6291 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:28.544253 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 6055
I20260809 00:46:28.562127 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 6309
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[5594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:46:28.577234 6575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:28.563102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56154 (local address 127.28.92.131:38397)
0809 00:46:28.563747 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:28.563754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:28.563783 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:46:28.563848 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:28.563854 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:28.564068 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:28.564223 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:28.565364 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.566488 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.567661 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:28.568207 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:28.568304 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:28.572113 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:28.572125 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:28.572142 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:28.572177 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:28.574899 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.575538 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.575545 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.575547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.575668 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:28.575958 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:28.575961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:28.575963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:28.576305 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:28.576545 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:28.576727 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 00:46:28.576934 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":320,"threads_started":1}
I20260809 00:46:28.578598 6527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:28.658887 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 6309
I20260809 00:46:28.681455 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 5618
I20260809 00:46:28.682736 5736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:28.784615 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 5618
2026-08-09T00:46:28Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4030 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[6584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[6584](info): set up 2 sockets
Aug 09 00:46:28 dist-test-slave-t7g5 krb5kdc[6584](info): commencing operation
krb5kdc: starting...
W20260809 00:46:29.988801 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:30 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:30Z Disabled control of system clock
WARNING: no policy specified for oryx/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab.
Entry for principal oryx/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab.
I20260809 00:46:30.227378 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36087
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab
--principal=oryx/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:30.552809 6602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:30.553102 6602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:30.553203 6602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:30.560425 6602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:30.560534 6602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:30.560587 6602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:30.560642 6602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:30.560685 6602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:30.570443 6602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab
--principal=oryx/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:30.571767 6602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:30.573052 6602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:30.584328 6615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:30.584367 6612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:30.584290 6610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:30.585417 6602 server_base.cc:1034] running on GCE node
I20260809 00:46:30.586184 6602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:30.587504 6602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:30.588706 6602 hybrid_clock.cc:648] HybridClock initialized: now 1786236390588667 us; error 25 us; skew 500 ppm
I20260809 00:46:30.589007 6602 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:30 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:30.591873 6602 init.cc:377] Logged in from keytab as oryx/127.28.92.190@KRBTEST.COM (short username oryx)
I20260809 00:46:30.593273 6602 webserver.cc:460] Webserver started at http://127.28.92.190:38345/ using document root <none> and password file <none>
I20260809 00:46:30.593966 6602 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:30.594081 6602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:30.594365 6602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:30.597328 6602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "223d2f0509f2472d8d6340b869bda3f5"
format_stamp: "Formatted at 2026-08-09 00:46:30 on dist-test-slave-t7g5"
server_key: "77955d42ad598c422d08ecfa7e544a12"
server_key_iv: "e51e3fc8c61f08a2c7d0713a253c4fde"
server_key_version: "encryptionkey@0"
I20260809 00:46:30.598085 6602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "223d2f0509f2472d8d6340b869bda3f5"
format_stamp: "Formatted at 2026-08-09 00:46:30 on dist-test-slave-t7g5"
server_key: "77955d42ad598c422d08ecfa7e544a12"
server_key_iv: "e51e3fc8c61f08a2c7d0713a253c4fde"
server_key_version: "encryptionkey@0"
I20260809 00:46:30.602913 6602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 00:46:30.606187 6626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:30.607430 6602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:46:30.607584 6602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "223d2f0509f2472d8d6340b869bda3f5"
format_stamp: "Formatted at 2026-08-09 00:46:30 on dist-test-slave-t7g5"
server_key: "77955d42ad598c422d08ecfa7e544a12"
server_key_iv: "e51e3fc8c61f08a2c7d0713a253c4fde"
server_key_version: "encryptionkey@0"
I20260809 00:46:30.607750 6602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:30.621512 6602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:30.625059 6602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:30.625304 6602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:30.642241 6602 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:36087
I20260809 00:46:30.642283 6713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:36087 every 8 connection(s)
I20260809 00:46:30.643620 6602 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:30.647094 6717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:30.648078 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 6602
I20260809 00:46:30.648257 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:30.648898 29042 external_mini_cluster.cc:1428] Setting key 5dbf77688773a6680722c6d0547e6038
I20260809 00:46:30.660780 6717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Bootstrap starting.
Aug 09 00:46:30 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:30.664494 6717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:30.665522 6717 log.cc:824] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:30.668612 6717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: No bootstrap required, opened a new log
I20260809 00:46:30.672022 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:30.650831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60910 (local address 127.28.92.190:36087)
0809 00:46:30.651672 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:30.651683 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:30.651725 (+ 42us) server_negotiation.cc:407] Connection header received
0809 00:46:30.653256 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:30.653280 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:30.653744 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:30.654060 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:30.655828 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:30.657108 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:30.658856 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:30.659501 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:30.659621 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:30.664208 (+ 4587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:30.664215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:30.664228 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:30.664262 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:30.667445 (+ 3183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:30.668193 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:30.668200 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:30.668205 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:30.668361 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:30.668796 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:30.668801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:30.668804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:30.669531 (+ 727us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:30.669872 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:30.670210 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 00:46:30.670640 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":362,"threads_started":1}
I20260809 00:46:30.677868 6717 raft_consensus.cc:348] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } }
I20260809 00:46:30.678202 6717 raft_consensus.cc:374] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:30.678292 6717 raft_consensus.cc:729] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223d2f0509f2472d8d6340b869bda3f5, State: Initialized, Role: FOLLOWER
I20260809 00:46:30.678889 6717 consensus_queue.cc:260] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } }
I20260809 00:46:30.679147 6717 raft_consensus.cc:388] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:30.679289 6717 raft_consensus.cc:482] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:30.679453 6717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:30.681537 6717 raft_consensus.cc:504] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } }
I20260809 00:46:30.682020 6717 leader_election.cc:302] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 223d2f0509f2472d8d6340b869bda3f5; no voters:
I20260809 00:46:30.682608 6717 leader_election.cc:288] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:30.682695 6726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:30.683768 6726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 223d2f0509f2472d8d6340b869bda3f5, State: Running, Role: LEADER
I20260809 00:46:30.684244 6726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } }
I20260809 00:46:30.684648 6717 sys_catalog.cc:564] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:30.686753 6728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 223d2f0509f2472d8d6340b869bda3f5. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } }
I20260809 00:46:30.687139 6728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:30.687678 6727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } }
I20260809 00:46:30.687999 6727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:30.688089 6740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:30.693717 6740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:30.702808 6740 catalog_manager.cc:1347] Generated new cluster ID: 03ec1d7e74a64fd1a6736a685882aa74
I20260809 00:46:30.702927 6740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:30.720431 6740 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:30.722311 6740 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:30.736824 6740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Generated new TSK 0
I20260809 00:46:30.737952 6740 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab.
Entry for principal oryx/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab.
I20260809 00:46:30.797161 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36087
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:31.138711 6763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:31.138994 6763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:31.139103 6763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:31.146193 6763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:31.146311 6763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:31.146431 6763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:31.156019 6763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:31.157306 6763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:31.158643 6763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:31.171005 6779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:31.170962 6776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:31.171396 6774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:31.172138 6763 server_base.cc:1034] running on GCE node
I20260809 00:46:31.172864 6763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:31.173871 6763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:31.175093 6763 hybrid_clock.cc:648] HybridClock initialized: now 1786236391175043 us; error 43 us; skew 500 ppm
I20260809 00:46:31.175401 6763 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:31 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236391, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:31.178614 6763 init.cc:377] Logged in from keytab as oryx/127.28.92.129@KRBTEST.COM (short username oryx)
I20260809 00:46:31.180058 6763 webserver.cc:460] Webserver started at http://127.28.92.129:39871/ using document root <none> and password file <none>
I20260809 00:46:31.180759 6763 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:31.180864 6763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:31.181121 6763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:31.184072 6763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "33bfcac3cc5449249643646b85a1530c"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "fb9a256a3f58bfd1e22ed683d6cdc073"
server_key_iv: "0016c7916bac773d1d866bd7288b9667"
server_key_version: "encryptionkey@0"
I20260809 00:46:31.184839 6763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "33bfcac3cc5449249643646b85a1530c"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "fb9a256a3f58bfd1e22ed683d6cdc073"
server_key_iv: "0016c7916bac773d1d866bd7288b9667"
server_key_version: "encryptionkey@0"
I20260809 00:46:31.190521 6763 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260809 00:46:31.194604 6791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:31.196334 6763 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:46:31.196516 6763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "33bfcac3cc5449249643646b85a1530c"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "fb9a256a3f58bfd1e22ed683d6cdc073"
server_key_iv: "0016c7916bac773d1d866bd7288b9667"
server_key_version: "encryptionkey@0"
I20260809 00:46:31.196758 6763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:31.235703 6763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:31.239794 6763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:31.240064 6763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:31.240990 6763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:31.242349 6763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:31.242424 6763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:31.242561 6763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:31.242615 6763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:31.271347 6763 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:42115
I20260809 00:46:31.271389 6993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:42115 every 8 connection(s)
I20260809 00:46:31.272603 6763 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:31.273104 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 6763
I20260809 00:46:31.273315 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:31.274173 29042 external_mini_cluster.cc:1428] Setting key d1b00f40157295fbc804fca9fce7ea59
Aug 09 00:46:31 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236391, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:31.294417 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:31.275261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:52627 (local address 127.28.92.190:36087)
0809 00:46:31.275708 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:31.275712 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:31.278234 (+ 2522us) server_negotiation.cc:407] Connection header received
0809 00:46:31.279990 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:31.279995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:31.280076 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:31.280168 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:31.281621 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.282367 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.283870 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.284286 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.284397 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:31.288038 (+ 3641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:31.288045 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:31.288049 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:31.288087 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:31.291307 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:31.292026 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:31.292032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:31.292035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:31.292180 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:31.292593 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:31.292599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:31.292601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:31.292961 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:31.293095 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:31.293824 (+ 729us) server_negotiation.cc:299] Negotiation successful
0809 00:46:31.294062 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":241,"threads_started":1}
I20260809 00:46:31.295212 7002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:31.275908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:52627)
0809 00:46:31.278091 (+ 2183us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:31.278136 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:31.279731 (+ 1595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:31.280408 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:31.280416 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:31.280907 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:31.281456 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:31.281474 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.282516 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.282520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:31.283723 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:31.283735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.284521 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.284528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:31.284767 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:31.285415 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:31.285442 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:31.287806 (+ 2364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:31.291453 (+ 3647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:31.291461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:31.291474 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:31.291908 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:31.292276 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:31.292279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:31.292281 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:31.292477 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:31.293070 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:31.293075 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:31.293404 (+ 329us) client_negotiation.cc:769] Sending connection context
0809 00:46:31.293670 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 00:46:31.294091 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1951,"thread_start_us":1752,"threads_started":1}
I20260809 00:46:31.296814 6995 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36087
I20260809 00:46:31.297118 6995 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:31.297883 6995 heartbeater.cc:511] Master 127.28.92.190:36087 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.28.92.130@KRBTEST.COM; defaulting to no policy
I20260809 00:46:31.299925 6649 ts_manager.cc:194] Registered new tserver with Master: 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115)
I20260809 00:46:31.301503 6649 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:52627
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab.
Entry for principal oryx/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab.
I20260809 00:46:31.327059 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36087
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:31.650673 7007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:31.650955 7007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:31.651080 7007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:31.658255 7007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:31.658366 7007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:31.658527 7007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:31.668087 7007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:31.669361 7007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:31.670737 7007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:31.683239 7018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:31.683331 7020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:31.683269 7028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:31.684197 7007 server_base.cc:1034] running on GCE node
I20260809 00:46:31.684819 7007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:31.685767 7007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:31.686950 7007 hybrid_clock.cc:648] HybridClock initialized: now 1786236391686903 us; error 43 us; skew 500 ppm
I20260809 00:46:31.687232 7007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:31 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236391, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:31.693017 7007 init.cc:377] Logged in from keytab as oryx/127.28.92.130@KRBTEST.COM (short username oryx)
I20260809 00:46:31.694568 7007 webserver.cc:460] Webserver started at http://127.28.92.130:45607/ using document root <none> and password file <none>
I20260809 00:46:31.695220 7007 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:31.695353 7007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:31.695701 7007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:31.698704 7007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "4fd22afd19fc468d819953bcab76ef57"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "0fe462944967dab5b364944d0bd674ce"
server_key_iv: "9500636b5f2d5c7ef2b8a60198cde759"
server_key_version: "encryptionkey@0"
I20260809 00:46:31.699416 7007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "4fd22afd19fc468d819953bcab76ef57"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "0fe462944967dab5b364944d0bd674ce"
server_key_iv: "9500636b5f2d5c7ef2b8a60198cde759"
server_key_version: "encryptionkey@0"
I20260809 00:46:31.704424 7007 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260809 00:46:31.707741 7042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:31.709049 7007 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:46:31.709197 7007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "4fd22afd19fc468d819953bcab76ef57"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "0fe462944967dab5b364944d0bd674ce"
server_key_iv: "9500636b5f2d5c7ef2b8a60198cde759"
server_key_version: "encryptionkey@0"
I20260809 00:46:31.709384 7007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:31.737799 7007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:31.741619 7007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:31.741930 7007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:31.742878 7007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:31.744208 7007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:31.744284 7007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:31.744400 7007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:31.744459 7007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:31.774771 7007 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:38573
I20260809 00:46:31.774812 7232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:38573 every 8 connection(s)
I20260809 00:46:31.776180 7007 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:31.778008 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 7007
I20260809 00:46:31.778200 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:31.778659 29042 external_mini_cluster.cc:1428] Setting key 25ce48be634df09f994ebe6721fc5ee4
Aug 09 00:46:31 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236391, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:31.797238 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:31.778975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:53605 (local address 127.28.92.190:36087)
0809 00:46:31.779188 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:31.779194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:31.780690 (+ 1496us) server_negotiation.cc:407] Connection header received
0809 00:46:31.782713 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:31.782718 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:31.782801 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:31.782906 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:31.784456 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.785442 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.787102 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.787675 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.787798 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:31.791334 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:31.791339 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:31.791343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:31.791379 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:31.793937 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:31.794731 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:31.794736 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:31.794739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:31.794904 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:31.795314 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:31.795319 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:31.795322 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:31.795732 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:31.795875 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:31.796659 (+ 784us) server_negotiation.cc:299] Negotiation successful
0809 00:46:31.796897 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 00:46:31.798170 7238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:31.779661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:53605)
0809 00:46:31.780518 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:31.780576 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:31.782422 (+ 1846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:31.783124 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:31.783133 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:31.783676 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:31.784269 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:31.784287 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.785586 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.785590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:31.786953 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:31.786967 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:31.787869 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:31.787874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:31.788073 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:31.788751 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:31.788775 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:31.791098 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:31.794091 (+ 2993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:31.794100 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:31.794121 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:31.794575 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:31.794999 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:31.795002 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:31.795004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:31.795193 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:31.795879 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:31.795888 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:31.796251 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 00:46:31.796489 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 00:46:31.796910 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":330,"threads_started":1}
I20260809 00:46:31.799630 7234 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36087
I20260809 00:46:31.800002 7234 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:31.800982 7234 heartbeater.cc:511] Master 127.28.92.190:36087 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.28.92.131@KRBTEST.COM; defaulting to no policy
I20260809 00:46:31.802842 6649 ts_manager.cc:194] Registered new tserver with Master: 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:31.803879 6649 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:53605
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab.
Entry for principal oryx/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab.
I20260809 00:46:31.832638 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36087
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:32.152710 7244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:32.153007 7244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:32.153143 7244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:32.160398 7244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:32.160529 7244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:32.160689 7244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:32.170854 7244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36087
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:32.172179 7244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:32.173508 7244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:32.186144 7254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:32.186235 7261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:32.186215 7256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:32.187225 7244 server_base.cc:1034] running on GCE node
I20260809 00:46:32.187824 7244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:32.188750 7244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:32.189967 7244 hybrid_clock.cc:648] HybridClock initialized: now 1786236392189878 us; error 76 us; skew 500 ppm
I20260809 00:46:32.190327 7244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236392, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:32.194360 7244 init.cc:377] Logged in from keytab as oryx/127.28.92.131@KRBTEST.COM (short username oryx)
I20260809 00:46:32.196318 7244 webserver.cc:460] Webserver started at http://127.28.92.131:39663/ using document root <none> and password file <none>
I20260809 00:46:32.197209 7244 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:32.197345 7244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:32.197646 7244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:32.200806 7244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "9d7b997559ca472f89c4a20a9c992c46"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "fd65e03e79a02e8a3fc30ea495292055"
server_key_iv: "978674d18aed4772a3b17a85080ce527"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.201640 7244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "9d7b997559ca472f89c4a20a9c992c46"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "fd65e03e79a02e8a3fc30ea495292055"
server_key_iv: "978674d18aed4772a3b17a85080ce527"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.207068 7244 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:46:32.210539 7271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:32.211925 7244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 00:46:32.212085 7244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "9d7b997559ca472f89c4a20a9c992c46"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "fd65e03e79a02e8a3fc30ea495292055"
server_key_iv: "978674d18aed4772a3b17a85080ce527"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.212267 7244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:32.233040 7244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:32.237058 7244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:32.237330 7244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:32.238363 7244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:32.239710 7244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:32.239804 7244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:32.239931 7244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:32.239984 7244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:32.270170 7244 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:35485
I20260809 00:46:32.270218 7480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:35485 every 8 connection(s)
I20260809 00:46:32.271502 7244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:32.274577 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 7244
I20260809 00:46:32.274748 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:32.275359 29042 external_mini_cluster.cc:1428] Setting key d74fca14538a04a015e9248ebf030a7f
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236392, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:32.291642 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.274161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:60195 (local address 127.28.92.190:36087)
0809 00:46:32.274381 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.274387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.275734 (+ 1347us) server_negotiation.cc:407] Connection header received
0809 00:46:32.277936 (+ 2202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.277942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.278028 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.278143 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.279617 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.280370 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.281886 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.282291 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.282389 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.285674 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.285682 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.285685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.285718 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.288279 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.289021 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.289026 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.289030 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.289183 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.289755 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.289777 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.289780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.290146 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.290318 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.291190 (+ 872us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.291391 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260809 00:46:32.292520 7485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.274639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:60195)
0809 00:46:32.275569 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.275622 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:32.277674 (+ 2052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:32.278376 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:32.278388 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:32.278904 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:32.279463 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.279481 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.280485 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.280488 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.281777 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.281790 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.282471 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.282476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.282665 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.283282 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:32.283311 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:32.285471 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:32.288402 (+ 2931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.288408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.288420 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.288905 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.289325 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.289328 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.289331 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.289618 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.290276 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:32.290285 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:32.290738 (+ 453us) client_negotiation.cc:769] Sending connection context
0809 00:46:32.291043 (+ 305us) client_negotiation.cc:240] Negotiation successful
0809 00:46:32.291438 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":316,"threads_started":1}
I20260809 00:46:32.293792 7481 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36087
I20260809 00:46:32.294093 7481 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:32.294813 7481 heartbeater.cc:511] Master 127.28.92.190:36087 requested a full tablet report, sending...
I20260809 00:46:32.296211 6649 ts_manager.cc:194] Registered new tserver with Master: 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131:35485)
I20260809 00:46:32.296979 6649 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:60195
I20260809 00:46:32.303056 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:46:32.304427 6995 heartbeater.cc:503] Master 127.28.92.190:36087 was elected leader, sending a full tablet report...
WARNING: no policy specified for oryx/127.28.92.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.189.keytab.
Entry for principal oryx/127.28.92.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.189.keytab.
I20260809 00:46:32.356412 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:41241
--webserver_interface=127.28.92.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.189.keytab
--principal=oryx/127.28.92.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36087,127.28.92.189:41241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:32.675697 7488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:32.676005 7488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:32.676144 7488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:32.683233 7488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:32.683328 7488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:32.683379 7488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:32.683435 7488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:32.683480 7488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:32.693109 7488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36087,127.28.92.189:41241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.189.keytab
--principal=oryx/127.28.92.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:41241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.92.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
W20260809 00:46:32.693418 7488 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.28.92.190:36087,127.28.92.189:41241'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 00:46:32.694416 7488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:32.695676 7488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:32.706835 7500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:32.706813 7504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:32.706777 7502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:32.707718 7488 server_base.cc:1034] running on GCE node
I20260809 00:46:32.708461 7488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:32.709796 7488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:32.711015 7488 hybrid_clock.cc:648] HybridClock initialized: now 1786236392710953 us; error 38 us; skew 500 ppm
I20260809 00:46:32.711325 7488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236392, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:32.714432 7488 init.cc:377] Logged in from keytab as oryx/127.28.92.189@KRBTEST.COM (short username oryx)
I20260809 00:46:32.715902 7488 webserver.cc:460] Webserver started at http://127.28.92.189:43049/ using document root <none> and password file <none>
I20260809 00:46:32.716583 7488 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:32.716687 7488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:32.717006 7488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:32.720060 7488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/instance:
uuid: "464d927f6d404c2c8d5303862ada4e28"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "4e5d8f06b9daa1b73d7249d4297ae586"
server_key_iv: "0cebdcce5006f438ecdb1d6640133856"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.720806 7488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal/instance:
uuid: "464d927f6d404c2c8d5303862ada4e28"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "4e5d8f06b9daa1b73d7249d4297ae586"
server_key_iv: "0cebdcce5006f438ecdb1d6640133856"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.725725 7488 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:46:32.728899 7515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:32.730193 7488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:32.730343 7488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
uuid: "464d927f6d404c2c8d5303862ada4e28"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "4e5d8f06b9daa1b73d7249d4297ae586"
server_key_iv: "0cebdcce5006f438ecdb1d6640133856"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.730530 7488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:32.765182 7488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:32.769308 7488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:32.769568 7488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:32.787453 7488 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.189:41241
I20260809 00:46:32.787474 7609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.189:41241 every 8 connection(s)
I20260809 00:46:32.788746 7488 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
I20260809 00:46:32.792472 7610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:32.798391 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 7488
I20260809 00:46:32.799386 7610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:46:32.806504 7234 heartbeater.cc:503] Master 127.28.92.190:36087 was elected leader, sending a full tablet report...
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236392, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.189@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
I20260809 00:46:32.818661 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.802415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60924 (local address 127.28.92.190:36087)
0809 00:46:32.802892 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.802898 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.803430 (+ 532us) server_negotiation.cc:407] Connection header received
0809 00:46:32.804068 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.804072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.804144 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.804235 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.805557 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.806440 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.808351 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.808765 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.808859 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.812287 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.812294 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.812299 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.812340 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.815106 (+ 2766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.816052 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.816056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.816058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.816193 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.816616 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.816621 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.816624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.817160 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.817279 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.818086 (+ 807us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.818306 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":231,"threads_started":1}
I20260809 00:46:32.819875 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.800690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48362 (local address 127.28.92.189:41241)
0809 00:46:32.801514 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.801529 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.801582 (+ 53us) server_negotiation.cc:407] Connection header received
0809 00:46:32.803821 (+ 2239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.803847 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.804134 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.804314 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.805601 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.806926 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.808264 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.808843 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.809027 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.813299 (+ 4272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.813307 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.813320 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.813353 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.816251 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.817083 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.817090 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.817092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.817203 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.817583 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.817587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.817591 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.818110 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.818383 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.819031 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.819270 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"spinlock_wait_cycles":18816,"thread_start_us":340,"threads_started":1}
I20260809 00:46:32.819895 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.802467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:60924)
0809 00:46:32.803277 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.803324 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:32.803828 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:32.804309 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:32.804316 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:32.805035 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:32.805388 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.805404 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.806577 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.806583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.808226 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.808241 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.808981 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.808988 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.809142 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.809815 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:32.809838 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:32.812108 (+ 2270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:32.815230 (+ 3122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.815240 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.815257 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.815927 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.816294 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.816299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.816302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.816505 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.817276 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:32.817285 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:32.817629 (+ 344us) client_negotiation.cc:769] Sending connection context
0809 00:46:32.818009 (+ 380us) client_negotiation.cc:240] Negotiation successful
0809 00:46:32.818480 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"spinlock_wait_cycles":15744,"thread_start_us":388,"threads_started":1}
I20260809 00:46:32.822070 7610 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236392, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.189@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
I20260809 00:46:32.833364 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.822746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:48378)
0809 00:46:32.822955 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.822971 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:32.823060 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:32.823301 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:32.823305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:32.823622 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:32.823745 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.823752 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.824664 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.824668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.825494 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.825504 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.826144 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.826150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.826308 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.826748 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:32.826764 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:32.828615 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:32.831367 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.831371 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.831373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.831717 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.832023 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.832027 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.832029 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.832144 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.832612 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:32.832615 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:32.832733 (+ 118us) client_negotiation.cc:769] Sending connection context
0809 00:46:32.832837 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 00:46:32.833048 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260809 00:46:32.833425 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.822930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48378 (local address 127.28.92.189:41241)
0809 00:46:32.823093 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.823099 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.823113 (+ 14us) server_negotiation.cc:407] Connection header received
0809 00:46:32.823150 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.823155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.823201 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.823272 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.823867 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.824537 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.825613 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.826017 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.826129 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.828779 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.828784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.828787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.828816 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.831260 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.831808 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.831811 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.831813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.831929 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.832237 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.832240 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.832242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.832522 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.832628 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.832908 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.833190 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":64}
I20260809 00:46:32.838198 7610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Bootstrap starting.
I20260809 00:46:32.841248 7610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:32.842305 7610 log.cc:824] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:32.844877 7610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: No bootstrap required, opened a new log
I20260809 00:46:32.852082 7610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } }
I20260809 00:46:32.852456 7610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:32.852535 7610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 464d927f6d404c2c8d5303862ada4e28, State: Initialized, Role: FOLLOWER
I20260809 00:46:32.853082 7610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } }
I20260809 00:46:32.853929 7621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } } }
I20260809 00:46:32.854239 7621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:46:32.854974 7610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 00:46:32.863818 7638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:46:32.863978 7638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:46:32.867573 7488 master_runner.cc:428] Detected that this master 464d927f6d404c2c8d5303862ada4e28 is joining an existing cluster
I20260809 00:46:32.867688 7488 master_runner.cc:432] Initiating AddMaster RPC to add 127.28.92.189:41241
I20260809 00:46:32.887523 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.871915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60938 (local address 127.28.92.190:36087)
0809 00:46:32.872156 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.872162 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.872653 (+ 491us) server_negotiation.cc:407] Connection header received
0809 00:46:32.872831 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.872837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.872970 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.873079 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.874523 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.875724 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.877930 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.878631 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.878731 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.880898 (+ 2167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.880904 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.880909 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.880949 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.884350 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.885151 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.885156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.885159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.885317 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.885813 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.885818 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.885822 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.886192 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.886339 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.886935 (+ 596us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.887192 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260809 00:46:32.887580 7645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.871888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:60938)
0809 00:46:32.872542 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.872562 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:32.872700 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:32.873120 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:32.873126 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:32.873886 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:32.874325 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.874339 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.875922 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.875928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.877741 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.877758 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.879055 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.879061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.879245 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.879897 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:32.879914 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:32.880703 (+ 789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:32.884522 (+ 3819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.884528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.884531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.885009 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.885464 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.885469 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.885472 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.885671 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.886410 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:32.886416 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:32.886643 (+ 227us) client_negotiation.cc:769] Sending connection context
0809 00:46:32.886802 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 00:46:32.887114 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":340,"threads_started":1}
I20260809 00:46:32.903980 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.872784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48382 (local address 127.28.92.189:41241)
0809 00:46:32.873330 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.873336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.881112 (+ 7776us) server_negotiation.cc:407] Connection header received
0809 00:46:32.881307 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.881311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.881372 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.881443 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.882614 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.883739 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.885701 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.886375 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.886460 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.890122 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.890129 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.890134 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.890167 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.893628 (+ 3461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.894448 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.894454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.894457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.894603 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.901690 (+ 7087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.901695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.901698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.902867 (+ 1169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.903056 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.903426 (+ 370us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.903695 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432}
WARNING: no policy specified for oryx/127.28.92.188@KRBTEST.COM; defaulting to no policy
I20260809 00:46:32.904821 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.872902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:48382)
0809 00:46:32.881021 (+ 8119us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.881041 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:32.881191 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:32.881616 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:32.881619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:32.882181 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:32.882451 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.882462 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.883931 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.883936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.885516 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.885532 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.888005 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.888010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.888192 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.888769 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:32.888796 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:32.889948 (+ 1152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:32.893789 (+ 3841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.893794 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.893798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.894308 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.901070 (+ 6762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.901075 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.901083 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.901525 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.903008 (+ 1483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:32.903013 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:32.903186 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 00:46:32.904219 (+ 1033us) client_negotiation.cc:240] Negotiation successful
0809 00:46:32.904483 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7986,"thread_start_us":6780,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.188@KRBTEST.COM" created.
Aug 09 00:46:32 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.190@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
I20260809 00:46:32.923271 7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.894836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:48398)
0809 00:46:32.902528 (+ 7692us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.902586 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:32.902767 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:32.905095 (+ 2328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:32.905104 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:32.906021 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:32.906332 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.906349 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.910808 (+ 4459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.910813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.911937 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:32.911954 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.912804 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.912810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:32.912985 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.913745 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:32.913770 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:32.916009 (+ 2239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:32.920058 (+ 4049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.920073 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.920081 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.920642 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.921123 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:32.921128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:32.921132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:32.921324 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:32.922055 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:32.922064 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:32.922281 (+ 217us) client_negotiation.cc:769] Sending connection context
0809 00:46:32.922494 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 00:46:32.922866 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6908,"thread_start_us":6746,"threads_started":1}
I20260809 00:46:32.923281 7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.894850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48398 (local address 127.28.92.189:41241)
0809 00:46:32.902555 (+ 7705us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:32.902561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:32.902690 (+ 129us) server_negotiation.cc:407] Connection header received
0809 00:46:32.902966 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:32.902971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:32.903057 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:32.903456 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:32.906565 (+ 3109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.910671 (+ 4106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.912142 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:32.912638 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:32.912746 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:32.916255 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:32.916264 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:32.916267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:32.916301 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:32.919892 (+ 3591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.920798 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.920804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.920808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.920990 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:32.921460 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:32.921466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:32.921469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:32.921899 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:32.922047 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:32.922623 (+ 576us) server_negotiation.cc:299] Negotiation successful
0809 00:46:32.922855 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6248,"thread_start_us":6025,"threads_started":1}
I20260809 00:46:32.925555 6648 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.28.92.189:41241: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "464d927f6d404c2c8d5303862ada4e28"
member_type: NON_VOTER
last_known_addr {
host: "127.28.92.189"
port: 41241
}
attrs {
promote: true
}
}
dest_uuid: "223d2f0509f2472d8d6340b869bda3f5"
cas_config_opid_index: -1
I20260809 00:46:32.927309 6648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } }
I20260809 00:46:32.932776 7652 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 464d927f6d404c2c8d5303862ada4e28 (127.28.92.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } }
I20260809 00:46:32.933985 7567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:32.937870 7567 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Refusing update from remote peer 223d2f0509f2472d8d6340b869bda3f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 00:46:32.937467 7652 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.28.92.189:41241
I20260809 00:46:32.939092 7652 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:32.939565 7488 master.cc:537] Master@127.28.92.189:41241 shutting down...
I20260809 00:46:32.939733 7653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } }
I20260809 00:46:32.940354 7653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.188.keytab.
Entry for principal oryx/127.28.92.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.188.keytab.
I20260809 00:46:32.945636 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:46319
--webserver_interface=127.28.92.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.188.keytab
--principal=oryx/127.28.92.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:46:32.955251 7488 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:32.955737 7488 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:32.955941 7488 tablet_replica.cc:330] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: stopping tablet replica
W20260809 00:46:32.965032 6632 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from unknown peer (error 108)
I20260809 00:46:32.966879 7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:32.966409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:48404)
0809 00:46:32.966591 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:32.966718 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41241: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 00:46:32.967180 6632 consensus_peers.cc:487] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 -> Peer 464d927f6d404c2c8d5303862ada4e28 (127.28.92.189:41241): Couldn't send request to peer 464d927f6d404c2c8d5303862ada4e28. Status: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 00:46:32.973611 7488 master.cc:552] Master@127.28.92.189:41241 shutdown complete.
I20260809 00:46:32.973803 7488 master_runner.cc:305] Clearing existing system tablet
I20260809 00:46:32.974268 7488 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:32.974366 7488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:32.978329 7488 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:46:32.980870 7661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:32.981359 7488 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:32.981637 7488 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 00:46:32.981783 7488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
uuid: "464d927f6d404c2c8d5303862ada4e28"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "4e5d8f06b9daa1b73d7249d4297ae586"
server_key_iv: "0cebdcce5006f438ecdb1d6640133856"
server_key_version: "encryptionkey@0"
I20260809 00:46:32.987150 7488 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:32.994076 7488 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 00:46:32.994272 7488 log.cc:1196] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 00:46:32.994685 7488 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Deleting consensus metadata
I20260809 00:46:32.994935 7488 master_runner.cc:315] Copying system tablet from 127.28.92.190:36087
I20260809 00:46:32.999213 7488 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: tablet copy: Beginning tablet copy session from remote peer at address 127.28.92.190:36087
I20260809 00:46:33.016233 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.000712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60944 (local address 127.28.92.190:36087)
0809 00:46:33.000918 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.000924 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.001032 (+ 108us) server_negotiation.cc:407] Connection header received
0809 00:46:33.001336 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.001343 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.001449 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.001560 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.002733 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.003915 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.005880 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.006520 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.006660 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.008988 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.008995 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.009000 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.009041 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.012801 (+ 3760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.013644 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.013682 (+ 38us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.013686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.013896 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.014366 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.014372 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.014375 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.014758 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.014927 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.015459 (+ 532us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.015717 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:46:33.017014 7668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.000278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:60944)
0809 00:46:33.000852 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.000877 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.001163 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.001644 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.001672 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.002247 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.002575 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.002588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.004103 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.004109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.005630 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.005647 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.006690 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.006696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.006894 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.007601 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.007627 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.008750 (+ 1123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.012948 (+ 4198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.012955 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.012959 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.013512 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.014035 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.014040 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.014044 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.014239 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.014904 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.014909 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.015091 (+ 182us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.015263 (+ 172us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.015672 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":683,"threads_started":1}
I20260809 00:46:33.018100 6688 tablet_copy_service.cc:140] P 223d2f0509f2472d8d6340b869bda3f5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 464d927f6d404c2c8d5303862ada4e28 ({username='oryx', principal='oryx/127.28.92.189@KRBTEST.COM'} at 127.0.0.1:60944)
I20260809 00:46:33.018594 6688 tablet_copy_service.cc:161] P 223d2f0509f2472d8d6340b869bda3f5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 464d927f6d404c2c8d5303862ada4e28 at {username='oryx', principal='oryx/127.28.92.189@KRBTEST.COM'} at 127.0.0.1:60944: session id = 464d927f6d404c2c8d5303862ada4e28-00000000000000000000000000000000
I20260809 00:46:33.023671 6688 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 00:46:33.026857 7488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 00:46:33.034361 7488 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: tablet copy: Starting download of 0 data blocks...
I20260809 00:46:33.034772 7488 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: tablet copy: Starting download of 1 WAL segments...
I20260809 00:46:33.042804 7488 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 00:46:33.048372 6688 tablet_copy_service.cc:342] P 223d2f0509f2472d8d6340b869bda3f5: Request end of tablet copy session 464d927f6d404c2c8d5303862ada4e28-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.28.92.189@KRBTEST.COM'} at 127.0.0.1:60944
I20260809 00:46:33.048691 6688 tablet_copy_service.cc:433] P 223d2f0509f2472d8d6340b869bda3f5: ending tablet copy session 464d927f6d404c2c8d5303862ada4e28-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 464d927f6d404c2c8d5303862ada4e28
I20260809 00:46:33.066656 7488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:33.076680 7671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:33.077025 7669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:33.086084 7673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:33.089008 7488 server_base.cc:1034] running on GCE node
I20260809 00:46:33.089612 7488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:33.090395 7488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:33.091615 7488 hybrid_clock.cc:648] HybridClock initialized: now 1786236393091496 us; error 50 us; skew 500 ppm
I20260809 00:46:33.092131 7488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236393, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:33.095104 7488 init.cc:377] Logged in from keytab as oryx/127.28.92.189@KRBTEST.COM (short username oryx)
I20260809 00:46:33.108040 7488 webserver.cc:460] Webserver started at http://127.28.92.189:35661/ using document root <none> and password file <none>
I20260809 00:46:33.108592 7488 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:33.108777 7488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:33.112447 7488 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260809 00:46:33.114989 7685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:33.115394 7488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 00:46:33.115669 7488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
uuid: "464d927f6d404c2c8d5303862ada4e28"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "4e5d8f06b9daa1b73d7249d4297ae586"
server_key_iv: "0cebdcce5006f438ecdb1d6640133856"
server_key_version: "encryptionkey@0"
I20260809 00:46:33.116020 7488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:33.136546 7488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:33.140794 7488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:33.160681 7488 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.189:41241
I20260809 00:46:33.160750 7785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.189:41241 every 8 connection(s)
I20260809 00:46:33.162039 7488 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
I20260809 00:46:33.167481 7788 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:46:33.171408 7788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Bootstrap starting.
I20260809 00:46:33.190264 7788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:46:33.190858 7788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: Bootstrap complete.
I20260809 00:46:33.192044 7788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } }
I20260809 00:46:33.192344 7788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 464d927f6d404c2c8d5303862ada4e28, State: Initialized, Role: LEARNER
I20260809 00:46:33.192627 7788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } }
I20260809 00:46:33.202327 7788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:33.202327 7791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } }
I20260809 00:46:33.204025 7791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: LEARNER
I20260809 00:46:33.249507 7806 catalog_manager.cc:1259] Loaded cluster ID: 03ec1d7e74a64fd1a6736a685882aa74
I20260809 00:46:33.249720 7806 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: loading cluster ID for follower catalog manager: success
I20260809 00:46:33.252876 7806 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: acquiring CA information for follower catalog manager: success
I20260809 00:46:33.255753 7806 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 00:46:33.299731 7481 heartbeater.cc:503] Master 127.28.92.190:36087 was elected leader, sending a full tablet report...
W20260809 00:46:33.533569 7656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:33.534039 7656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:33.534250 7656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:33.544631 7656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:33.544782 7656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:33.544914 7656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:33.545114 7656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:33.545269 7656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:33.546264 7816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.539009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48412 (local address 127.28.92.189:41241)
0809 00:46:33.539528 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.539532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.539552 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:46:33.539714 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.539718 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.539792 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.540035 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:33.540523 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.541551 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.544131 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.545089 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.545202 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.545447 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.545873 (+ 426us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.545987 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":284,"threads_started":1}
I20260809 00:46:33.546468 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.538680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:48412)
0809 00:46:33.539158 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.539182 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.539551 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.540110 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.540115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.540146 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:33.540370 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.540384 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.541721 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.541727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.543982 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.543998 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.545354 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.545363 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.545681 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.545753 (+ 72us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.545852 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.545991 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":229,"threads_started":1}
I20260809 00:46:33.547680 7734 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260809 00:46:33.548403 7791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 223d2f0509f2472d8d6340b869bda3f5. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } }
I20260809 00:46:33.548691 7791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: LEARNER
I20260809 00:46:33.559082 7656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.188.keytab
--principal=oryx/127.28.92.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:46319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.92.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:33.561239 7656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:33.563357 7656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:33.578912 7819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:33.579109 7821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:33.579159 7827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:33.583433 7656 server_base.cc:1034] running on GCE node
I20260809 00:46:33.584483 7656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:33.586311 7656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:33.587620 7656 hybrid_clock.cc:648] HybridClock initialized: now 1786236393587467 us; error 41 us; skew 500 ppm
I20260809 00:46:33.588003 7656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236393, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:33.592190 7656 init.cc:377] Logged in from keytab as oryx/127.28.92.188@KRBTEST.COM (short username oryx)
I20260809 00:46:33.594197 7656 webserver.cc:460] Webserver started at http://127.28.92.188:46141/ using document root <none> and password file <none>
I20260809 00:46:33.594993 7656 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:33.595125 7656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:33.595451 7656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:33.599198 7656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/instance:
uuid: "0b839134fd4a42dfaa015e20fcd78375"
format_stamp: "Formatted at 2026-08-09 00:46:33 on dist-test-slave-t7g5"
server_key: "083a403887c1efc769b0405cbaf544ad"
server_key_iv: "a9ba18a15f36ec1063c1ab4b422a998d"
server_key_version: "encryptionkey@0"
I20260809 00:46:33.600121 7656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal/instance:
uuid: "0b839134fd4a42dfaa015e20fcd78375"
format_stamp: "Formatted at 2026-08-09 00:46:33 on dist-test-slave-t7g5"
server_key: "083a403887c1efc769b0405cbaf544ad"
server_key_iv: "a9ba18a15f36ec1063c1ab4b422a998d"
server_key_version: "encryptionkey@0"
I20260809 00:46:33.607055 7656 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260809 00:46:33.611671 7838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:33.613210 7656 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 00:46:33.613454 7656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
uuid: "0b839134fd4a42dfaa015e20fcd78375"
format_stamp: "Formatted at 2026-08-09 00:46:33 on dist-test-slave-t7g5"
server_key: "083a403887c1efc769b0405cbaf544ad"
server_key_iv: "a9ba18a15f36ec1063c1ab4b422a998d"
server_key_version: "encryptionkey@0"
I20260809 00:46:33.613816 7656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:33.651175 7656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:33.658303 7656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:33.658835 7656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:33.703550 7656 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.188:46319
I20260809 00:46:33.703747 7918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.188:46319 every 8 connection(s)
I20260809 00:46:33.705184 7656 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
I20260809 00:46:33.709992 7920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:33.714401 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 7656
I20260809 00:46:33.720680 7920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.188@KRBTEST.COM
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236393, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.188@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:33.749444 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.716938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34836 (local address 127.28.92.188:46319)
0809 00:46:33.718417 (+ 1479us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.718430 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.718500 (+ 70us) server_negotiation.cc:407] Connection header received
0809 00:46:33.722224 (+ 3724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.722265 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.722938 (+ 673us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.723692 (+ 754us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.726055 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.728862 (+ 2807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.731371 (+ 2509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.732354 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.732530 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.739159 (+ 6629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.739170 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.739187 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.739257 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.743837 (+ 4580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.744915 (+ 1078us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.744922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.744929 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.745193 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.745732 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.745736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.745739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.746536 (+ 797us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.746909 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.747406 (+ 497us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.747838 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1247,"thread_start_us":1373,"threads_started":1}
I20260809 00:46:33.751521 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.725603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.28.92.190:36087)
0809 00:46:33.730216 (+ 4613us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.730223 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.731351 (+ 1128us) server_negotiation.cc:407] Connection header received
0809 00:46:33.731421 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.731426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.731504 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.731763 (+ 259us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.733757 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.735452 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.737743 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.738528 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.738669 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.744099 (+ 5430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.744107 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.744111 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.744158 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.748019 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.749183 (+ 1164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.749186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.749189 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.749346 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.749861 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.749865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.749868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.750277 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.750451 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.750961 (+ 510us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.751139 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4466,"thread_start_us":4280,"threads_started":1}
I20260809 00:46:33.751842 7930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.725636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:49568)
0809 00:46:33.730910 (+ 5274us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.730960 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.731234 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.731855 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.731863 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.733030 (+ 1167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.733533 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.733547 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.735658 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.735662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.737561 (+ 1899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.737575 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.738807 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.738813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.739046 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.739813 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.739837 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.743846 (+ 4009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.748147 (+ 4301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.748157 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.748164 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.749080 (+ 916us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.749476 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.749480 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.749483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.749739 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.750410 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.750415 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.750610 (+ 195us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.750812 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.751082 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4952,"thread_start_us":4712,"threads_started":1}
I20260809 00:46:33.753382 7920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236393, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.188@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
I20260809 00:46:33.767374 7816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.754208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42874 (local address 127.28.92.189:41241)
0809 00:46:33.754381 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.754386 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.754401 (+ 15us) server_negotiation.cc:407] Connection header received
0809 00:46:33.754452 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.754455 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.754513 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.754595 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.755263 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.756108 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.757447 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.758096 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.758193 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.761712 (+ 3519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.761719 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.761722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.761755 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.764971 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.765567 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.765571 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.765573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.765745 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.766118 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.766121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.766123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.766431 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.766534 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.766848 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.767086 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:46:33.767445 7930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.753984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:42874)
0809 00:46:33.754167 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.754186 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.754261 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.754616 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.754619 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.754969 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.755131 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.755139 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.756204 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.756207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.757305 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.757317 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.758210 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.758214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.758355 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.759019 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.759036 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.761510 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.765081 (+ 3571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.765085 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.765087 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.765465 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.765835 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.765838 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.765840 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.766039 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.766517 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.766520 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.766674 (+ 154us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.766777 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.767072 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 00:46:33.768558 7920 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236393, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.188@KRBTEST.COM for oryx/127.28.92.188@KRBTEST.COM
I20260809 00:46:33.785125 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.770309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34838 (local address 127.28.92.188:46319)
0809 00:46:33.770579 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.770584 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.770599 (+ 15us) server_negotiation.cc:407] Connection header received
0809 00:46:33.770649 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.770654 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.770718 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.770811 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.771728 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.772946 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.774208 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.774896 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.775028 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.779316 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.779321 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.779324 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.779352 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.782326 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.782993 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.782997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.782999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.783142 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.783600 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.783605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.783609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.783905 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.784016 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.784514 (+ 498us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.784705 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":159}
I20260809 00:46:33.785130 7930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.769902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34838)
0809 00:46:33.770217 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.770238 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.770354 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.770858 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.770862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.771390 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.771575 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.771588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.773062 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.773066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.774056 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.774071 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.775053 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.775059 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.775523 (+ 464us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.776341 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.776363 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.779151 (+ 2788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.782461 (+ 3310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.782465 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.782468 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.782888 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.783228 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.783232 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.783234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.783477 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.784000 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.784003 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.784276 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.784397 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.784596 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 00:46:33.791682 7920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Bootstrap starting.
I20260809 00:46:33.796255 7920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:33.797673 7920 log.cc:824] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:33.800706 7920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: No bootstrap required, opened a new log
I20260809 00:46:33.811058 7920 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } }
I20260809 00:46:33.811445 7920 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:33.811566 7920 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b839134fd4a42dfaa015e20fcd78375, State: Initialized, Role: FOLLOWER
I20260809 00:46:33.812249 7920 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } }
I20260809 00:46:33.813894 7933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } } }
I20260809 00:46:33.814608 7933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:46:33.814963 7920 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 00:46:33.830648 7947 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:46:33.830911 7947 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:46:33.835776 7656 master_runner.cc:428] Detected that this master 0b839134fd4a42dfaa015e20fcd78375 is joining an existing cluster
I20260809 00:46:33.835968 7656 master_runner.cc:432] Initiating AddMaster RPC to add 127.28.92.188:46319
I20260809 00:46:33.858357 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 6763
I20260809 00:46:33.872375 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.842643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49584 (local address 127.28.92.190:36087)
0809 00:46:33.842973 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.842980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.845086 (+ 2106us) server_negotiation.cc:407] Connection header received
0809 00:46:33.845474 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.845482 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.845632 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.845764 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.850102 (+ 4338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.851353 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.854731 (+ 3378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.855661 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.855784 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.859882 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.859891 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.859897 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.859946 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.867777 (+ 7831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.868952 (+ 1175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.868958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.868962 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.869227 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.869874 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.869880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.869883 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.870326 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.870478 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.871694 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.871940 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 00:46:33.877285 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.842678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34850 (local address 127.28.92.188:46319)
0809 00:46:33.843010 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.843017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.851982 (+ 8965us) server_negotiation.cc:407] Connection header received
0809 00:46:33.852312 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.852318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.852398 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.852483 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.855134 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.856619 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.859766 (+ 3147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.860789 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.860901 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.866237 (+ 5336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.866244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.866249 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.866288 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.871743 (+ 5455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.873073 (+ 1330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.873079 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.873082 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.873280 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.873761 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.873766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.873769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.874165 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.874352 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.875047 (+ 695us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.876572 (+ 1525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1134,"server-negotiator.queue_time_us":68}
I20260809 00:46:33.879889 7956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.843069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:49584)
0809 00:46:33.844829 (+ 1760us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.844856 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.845249 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.846069 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.846075 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.848453 (+ 2378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.849909 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.849928 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.851589 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.851596 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.854528 (+ 2932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.854546 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.856259 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.856271 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.856629 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.857538 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.857573 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.859619 (+ 2046us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.867939 (+ 8320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.867945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.867949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.868775 (+ 826us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.869381 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.869386 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.869390 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.869726 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.870546 (+ 820us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.870551 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.870931 (+ 380us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.871078 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.875803 (+ 4725us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1498,"thread_start_us":1189,"threads_started":1}
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.129@KRBTEST.COM
I20260809 00:46:33.886174 7959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.843347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34850)
0809 00:46:33.849975 (+ 6628us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.850001 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.852134 (+ 2133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.852741 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.852751 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.854186 (+ 1435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.854958 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.854977 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.857014 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.857020 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.859589 (+ 2569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.859605 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.861418 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.861428 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.861741 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.862477 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.862505 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.863964 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.871890 (+ 7926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.871895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.871899 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.872921 (+ 1022us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.873414 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.873419 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.873423 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.873607 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.874409 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.874413 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.874612 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.874767 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.876203 (+ 1436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6410,"mutex_wait_us":1071,"thread_start_us":6708,"threads_started":1}
I20260809 00:46:33.891072 7816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.845407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42886 (local address 127.28.92.189:41241)
0809 00:46:33.845637 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.845643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.850993 (+ 5350us) server_negotiation.cc:407] Connection header received
0809 00:46:33.851176 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.851182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.851276 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.851395 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.854297 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.855808 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.865133 (+ 9325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.866054 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.866170 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.873509 (+ 7339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.873518 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.873525 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.873570 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.878471 (+ 4901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.880297 (+ 1826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.880304 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.880307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.880510 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.885640 (+ 5130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.885646 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.886005 (+ 359us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.889190 (+ 3185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.889344 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.890141 (+ 797us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.890573 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 00:46:33.892724 7957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.845804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:42886)
0809 00:46:33.850682 (+ 4878us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.850713 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.851029 (+ 316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.851430 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.851435 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.853010 (+ 1575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.854086 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.854104 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.862827 (+ 8723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.862833 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.864941 (+ 2108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.864957 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.866828 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.866836 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.867071 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.868127 (+ 1056us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.868150 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.873211 (+ 5061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.878653 (+ 5442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.878659 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.878663 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.879212 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.880672 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.880676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.880680 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.880889 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.889457 (+ 8568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.889463 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.889770 (+ 307us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.891340 (+ 1570us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.892068 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4724,"thread_start_us":3183,"threads_started":1}
I20260809 00:46:33.894867 7960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.860725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48436 (local address 127.28.92.129:42115)
0809 00:46:33.862890 (+ 2165us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.862900 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.862936 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:46:33.863017 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.863028 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.863388 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.869200 (+ 5812us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.870374 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.872050 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.874689 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.875777 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.883439 (+ 7662us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.883760 (+ 321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.883775 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.883795 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.883838 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.889647 (+ 5809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.890677 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.890686 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.890690 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.890958 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.891670 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.891675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.891678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.892116 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.893742 (+ 1626us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.893920 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.894218 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1924,"thread_start_us":1697,"threads_started":1}
I20260809 00:46:33.897229 6988 generic_service.cc:196] Checking for leaks (request via RPC)
Aug 09 00:46:33 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.190@KRBTEST.COM for oryx/127.28.92.188@KRBTEST.COM
I20260809 00:46:33.910197 7928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.890233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34858 (local address 127.28.92.188:46319)
0809 00:46:33.890660 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.890665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.890680 (+ 15us) server_negotiation.cc:407] Connection header received
0809 00:46:33.890785 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.890790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.890933 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.892398 (+ 1465us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.892698 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.894016 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.895950 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.896650 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.900390 (+ 3740us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.902317 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.902328 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.902355 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.902419 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.907019 (+ 4600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.907877 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.907881 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.907884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.908070 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.908600 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.908604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.908606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.908978 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.909122 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.909529 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.909811 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313}
I20260809 00:46:33.910233 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.889601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34858)
0809 00:46:33.889897 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.889923 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.890029 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.891110 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.891116 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.891895 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.892256 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.892273 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.894203 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.894209 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.895775 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.895792 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.896842 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.896849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.897044 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.897900 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.897927 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.901969 (+ 4042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.907205 (+ 5236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.907211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.907216 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.907728 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.908206 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.908211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.908215 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.908474 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.909099 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.909104 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.909283 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.909412 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.909788 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173}
W20260809 00:46:33.912252 7848 tablet.cc:2369] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:33.912207 6648 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.28.92.188:46319: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375"
member_type: NON_VOTER
last_known_addr {
host: "127.28.92.188"
port: 46319
}
attrs {
promote: true
}
}
dest_uuid: "223d2f0509f2472d8d6340b869bda3f5"
cas_config_opid_index: 5
I20260809 00:46:33.913712 6648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } }
I20260809 00:46:33.915947 7812 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.918800 7734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 LEARNER]: Refusing update from remote peer 223d2f0509f2472d8d6340b869bda3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 00:46:33.921321 7880 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:33.926218 7812 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.28.92.188:46319
I20260809 00:46:33.927096 7656 master.cc:537] Master@127.28.92.188:46319 shutting down...
I20260809 00:46:33.927096 7880 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Refusing update from remote peer 223d2f0509f2472d8d6340b869bda3f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 00:46:33.927116 7812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.928117 7812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:33.924525 7963 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260809 00:46:33.932209 7968 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.001s
I20260809 00:46:33.943841 7656 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:33.944425 7656 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:33.944672 7656 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: stopping tablet replica
I20260809 00:46:33.946079 7734 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.950098 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.949527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34862)
0809 00:46:33.949772 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.949890 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:46319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260809 00:46:33.950353 6629 consensus_peers.cc:487] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 -> Peer 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188:46319): Couldn't send request to peer 0b839134fd4a42dfaa015e20fcd78375. Status: Network error: Client connection negotiation failed: client connection to 127.28.92.188:46319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 00:46:33.951277 7791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: NON_VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: true } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.951624 7791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: LEARNER
I20260809 00:46:33.952150 7963 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: attempting to promote NON_VOTER 464d927f6d404c2c8d5303862ada4e28 to VOTER
I20260809 00:46:33.952999 7963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } }
I20260809 00:46:33.954978 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.954535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34878)
0809 00:46:33.954722 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.954816 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:46319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 00:46:33.955786 7734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 LEARNER]: Refusing update from remote peer 223d2f0509f2472d8d6340b869bda3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 00:46:33.956259 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.955826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34884)
0809 00:46:33.956041 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.956128 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:46319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
W20260809 00:46:33.956645 6629 consensus_peers.cc:487] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 -> Peer 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188:46319): Couldn't send request to peer 0b839134fd4a42dfaa015e20fcd78375. Status: Network error: Client connection negotiation failed: client connection to 127.28.92.188:46319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 00:46:33.956849 7963 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260809 00:46:33.958986 7812 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 464d927f6d404c2c8d5303862ada4e28 (127.28.92.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.961586 7812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.962265 7812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:33.962019 7963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.962714 7963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:33.962827 7734 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 464d927f6d404c2c8d5303862ada4e28 (127.28.92.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.964093 7656 master.cc:552] Master@127.28.92.188:46319 shutdown complete.
I20260809 00:46:33.964190 7656 master_runner.cc:305] Clearing existing system tablet
I20260809 00:46:33.964603 7656 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:33.964725 7656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:33.965927 7791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:33.966234 7791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:46:33.968653 7656 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260809 00:46:33.970108 7977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:33.970533 7656 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:33.970773 7656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 00:46:33.970881 7656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
uuid: "0b839134fd4a42dfaa015e20fcd78375"
format_stamp: "Formatted at 2026-08-09 00:46:33 on dist-test-slave-t7g5"
server_key: "083a403887c1efc769b0405cbaf544ad"
server_key_iv: "a9ba18a15f36ec1063c1ab4b422a998d"
server_key_version: "encryptionkey@0"
I20260809 00:46:33.974257 7656 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:33.978935 7656 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 00:46:33.979094 7656 log.cc:1196] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 00:46:33.979525 7656 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Deleting consensus metadata
I20260809 00:46:33.979768 7656 master_runner.cc:315] Copying system tablet from 127.28.92.190:36087
I20260809 00:46:33.982326 7656 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: tablet copy: Beginning tablet copy session from remote peer at address 127.28.92.190:36087
I20260809 00:46:33.998504 7992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.983066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:49598)
0809 00:46:33.983650 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:33.983666 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:33.984053 (+ 387us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:33.984451 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:33.984464 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:33.984966 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:33.985162 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.985171 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.987245 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.987250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.988387 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:33.988399 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.989560 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.989568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:33.989918 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.990625 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:33.990646 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:33.991570 (+ 924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:33.995308 (+ 3738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.995314 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.995323 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.995740 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.996123 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:33.996128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:33.996132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:33.996421 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:33.997151 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:33.997156 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:33.997394 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 00:46:33.997522 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 00:46:33.997878 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":361,"threads_started":1}
I20260809 00:46:33.998611 7929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:33.983181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49598 (local address 127.28.92.190:36087)
0809 00:46:33.983449 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:33.983456 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:33.983921 (+ 465us) server_negotiation.cc:407] Connection header received
0809 00:46:33.984250 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:33.984256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:33.984323 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:33.984407 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:33.985620 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.987038 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.988548 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:33.989358 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:33.989485 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:33.991829 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:33.991835 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:33.991838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:33.991871 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:33.995180 (+ 3309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.995853 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.995859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.995861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.996009 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:33.996534 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:33.996538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:33.996540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:33.997001 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:33.997172 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:33.997714 (+ 542us) server_negotiation.cc:299] Negotiation successful
0809 00:46:33.998006 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260809 00:46:33.999567 6688 tablet_copy_service.cc:140] P 223d2f0509f2472d8d6340b869bda3f5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0b839134fd4a42dfaa015e20fcd78375 ({username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:49598)
I20260809 00:46:33.999799 6688 tablet_copy_service.cc:161] P 223d2f0509f2472d8d6340b869bda3f5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0b839134fd4a42dfaa015e20fcd78375 at {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:49598: session id = 0b839134fd4a42dfaa015e20fcd78375-00000000000000000000000000000000
I20260809 00:46:34.003378 6688 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 00:46:34.007613 7656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 00:46:34.014780 7656 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: tablet copy: Starting download of 0 data blocks...
I20260809 00:46:34.015108 7656 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: tablet copy: Starting download of 1 WAL segments...
I20260809 00:46:34.018288 7656 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 00:46:34.022846 6688 tablet_copy_service.cc:342] P 223d2f0509f2472d8d6340b869bda3f5: Request end of tablet copy session 0b839134fd4a42dfaa015e20fcd78375-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:49598
I20260809 00:46:34.022997 6688 tablet_copy_service.cc:433] P 223d2f0509f2472d8d6340b869bda3f5: ending tablet copy session 0b839134fd4a42dfaa015e20fcd78375-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0b839134fd4a42dfaa015e20fcd78375
I20260809 00:46:34.036551 7656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:34.039924 7993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:34.040762 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 6763
W20260809 00:46:34.049391 8000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:34.055048 7656 server_base.cc:1034] running on GCE node
W20260809 00:46:34.057991 7995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:34.058604 7656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:34.062052 7656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:34.063304 7656 hybrid_clock.cc:648] HybridClock initialized: now 1786236394063245 us; error 50 us; skew 500 ppm
I20260809 00:46:34.063591 7656 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:34 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236394, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:34.066030 7656 init.cc:377] Logged in from keytab as oryx/127.28.92.188@KRBTEST.COM (short username oryx)
I20260809 00:46:34.070197 7656 webserver.cc:460] Webserver started at http://127.28.92.188:35763/ using document root <none> and password file <none>
I20260809 00:46:34.070253 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:42115
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:36087
--webserver_port=39871
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:46:34.070603 7656 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:34.070712 7656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:34.074165 7656 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260809 00:46:34.076297 8010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:34.076738 7656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 00:46:34.076870 7656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
uuid: "0b839134fd4a42dfaa015e20fcd78375"
format_stamp: "Formatted at 2026-08-09 00:46:33 on dist-test-slave-t7g5"
server_key: "083a403887c1efc769b0405cbaf544ad"
server_key_iv: "a9ba18a15f36ec1063c1ab4b422a998d"
server_key_version: "encryptionkey@0"
I20260809 00:46:34.077072 7656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:34.107792 7656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:34.112228 7656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:34.146024 7656 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.188:46319
I20260809 00:46:34.146081 8097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.188:46319 every 8 connection(s)
I20260809 00:46:34.147106 7656 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
I20260809 00:46:34.152494 8099 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:46:34.156525 8099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Bootstrap starting.
I20260809 00:46:34.190394 8099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:46:34.190968 8099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Bootstrap complete.
I20260809 00:46:34.192094 8099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } }
I20260809 00:46:34.192413 8099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0b839134fd4a42dfaa015e20fcd78375, State: Initialized, Role: LEARNER
I20260809 00:46:34.192687 8099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } }
I20260809 00:46:34.198614 8099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:34.198314 8105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:34.199005 8105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: This master's current role is: LEARNER
I20260809 00:46:34.206677 8129 catalog_manager.cc:1259] Loaded cluster ID: 03ec1d7e74a64fd1a6736a685882aa74
I20260809 00:46:34.206815 8129 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: loading cluster ID for follower catalog manager: success
I20260809 00:46:34.210536 8129 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: acquiring CA information for follower catalog manager: success
I20260809 00:46:34.213130 8129 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 00:46:34.426365 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.418007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34896)
0809 00:46:34.418247 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:34.418272 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:34.418429 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:34.419105 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:34.419110 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:34.419141 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:34.419348 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.419364 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.420855 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.420861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.423441 (+ 2580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.423460 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.425464 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.425471 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.425689 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.425724 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 00:46:34.425813 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 00:46:34.426026 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 00:46:34.426553 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.418237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34896 (local address 127.28.92.188:46319)
0809 00:46:34.418781 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:34.418786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:34.418803 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:46:34.418865 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:34.418869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:34.418943 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:34.419044 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:34.419508 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.420689 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.423627 (+ 2938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.425246 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.425391 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.425771 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:34.425839 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 00:46:34.426015 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":302,"threads_started":1}
I20260809 00:46:34.427577 8052 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 00:46:34.428252 8105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 223d2f0509f2472d8d6340b869bda3f5. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:34.428541 8105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: This master's current role is: LEARNER
W20260809 00:46:34.512763 8011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:34.513206 8011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:34.513391 8011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:34.523975 8011 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:34.524281 8011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:34.524547 8011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:34.537899 8011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:42115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=39871
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:34.539379 8011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:34.540872 8011 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:34.555832 8144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:34.556677 8145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:34.557106 8147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:34.558261 8011 server_base.cc:1034] running on GCE node
I20260809 00:46:34.558914 8011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:34.559859 8011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:34.561050 8011 hybrid_clock.cc:648] HybridClock initialized: now 1786236394560995 us; error 51 us; skew 500 ppm
I20260809 00:46:34.561342 8011 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:34 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236394, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:34.564427 8011 init.cc:377] Logged in from keytab as oryx/127.28.92.129@KRBTEST.COM (short username oryx)
I20260809 00:46:34.566403 8011 webserver.cc:460] Webserver started at http://127.28.92.129:39871/ using document root <none> and password file <none>
I20260809 00:46:34.567231 8011 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:34.567418 8011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:34.574513 8011 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 00:46:34.578061 8160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:34.579486 8011 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:46:34.579665 8011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "33bfcac3cc5449249643646b85a1530c"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "fb9a256a3f58bfd1e22ed683d6cdc073"
server_key_iv: "0016c7916bac773d1d866bd7288b9667"
server_key_version: "encryptionkey@0"
I20260809 00:46:34.581288 8011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:34.620177 8011 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:34.625622 8011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:34.626025 8011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:34.627748 8011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:34.629773 8011 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:34.630000 8011 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 00:46:34.630215 8011 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:34.630395 8011 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:34.705725 8011 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:42115
I20260809 00:46:34.706036 8379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:42115 every 8 connection(s)
I20260809 00:46:34.707419 8011 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:34.708153 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 8011
I20260809 00:46:34.708606 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 7007
Aug 09 00:46:34 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.130@KRBTEST.COM
Aug 09 00:46:34 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236394, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.188@KRBTEST.COM
Aug 09 00:46:34 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236394, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:34.762456 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.714636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:35673 (local address 127.28.92.188:46319)
0809 00:46:34.714858 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:34.714865 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:34.723717 (+ 8852us) server_negotiation.cc:407] Connection header received
0809 00:46:34.728893 (+ 5176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:34.728901 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:34.729001 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:34.729075 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:34.732707 (+ 3632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.734450 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.743664 (+ 9214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.744631 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.744744 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.751004 (+ 6260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:34.751013 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:34.751019 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:34.751068 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:34.757151 (+ 6083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.758414 (+ 1263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.758422 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.758426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.758693 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.759476 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.759483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.759486 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.759945 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:34.760144 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:34.761410 (+ 1266us) server_negotiation.cc:299] Negotiation successful
0809 00:46:34.761845 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 00:46:34.764139 8388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.710149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37826 (local address 127.28.92.130:38573)
0809 00:46:34.729497 (+ 19348us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:34.729504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:34.729530 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:46:34.729585 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:34.729592 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:34.729922 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:34.730304 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:34.733690 (+ 3386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.735904 (+ 2214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.738835 (+ 2931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.740127 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.740239 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.749859 (+ 9620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:34.749880 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:34.749902 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:34.749966 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:34.758043 (+ 8077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.759259 (+ 1216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.759270 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.759274 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.759471 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.760258 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.760263 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.760266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.760825 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:34.761247 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:34.763118 (+ 1871us) server_negotiation.cc:299] Negotiation successful
0809 00:46:34.763492 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19180,"thread_start_us":18929,"threads_started":1}
I20260809 00:46:34.765386 8393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.713388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.28.92.129:35673)
0809 00:46:34.723399 (+ 10011us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:34.723463 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:34.728437 (+ 4974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:34.729781 (+ 1344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:34.729795 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:34.731034 (+ 1239us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:34.732479 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.732508 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.734686 (+ 2178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.734692 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.738251 (+ 3559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.738270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.745276 (+ 7006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.745286 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.745848 (+ 562us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.746785 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:34.746810 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:34.750581 (+ 3771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:34.757366 (+ 6785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:34.757377 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:34.757399 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:34.758256 (+ 857us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:34.758864 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:34.758869 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:34.758872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:34.759322 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:34.760266 (+ 944us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:34.760276 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:34.760836 (+ 560us) client_negotiation.cc:769] Sending connection context
0809 00:46:34.762716 (+ 1880us) client_negotiation.cc:240] Negotiation successful
0809 00:46:34.763360 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9519,"thread_start_us":10222,"threads_started":1}
I20260809 00:46:34.766348 7226 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:34.769912 8380 heartbeater.cc:347] Connected to a master server at 127.28.92.188:46319
I20260809 00:46:34.770380 8380 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:34.771284 8397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.717497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:48557 (local address 127.28.92.190:36087)
0809 00:46:34.728739 (+ 11242us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:34.728747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:34.738955 (+ 10208us) server_negotiation.cc:407] Connection header received
0809 00:46:34.739286 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:34.739293 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:34.739398 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:34.739708 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:34.743566 (+ 3858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.744811 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.747510 (+ 2699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.747976 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.748090 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.758879 (+ 10789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:34.758889 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:34.758895 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:34.758949 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:34.763606 (+ 4657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.764996 (+ 1390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.765003 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.765006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.765295 (+ 289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.767022 (+ 1727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.767027 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.767031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.768084 (+ 1053us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:34.768238 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:34.770433 (+ 2195us) server_negotiation.cc:299] Negotiation successful
0809 00:46:34.770749 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11093,"thread_start_us":11246,"threads_started":1}
I20260809 00:46:34.771647 8395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.716658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:48557)
0809 00:46:34.738571 (+ 21913us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:34.738590 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:34.739134 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:34.739989 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:34.739994 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:34.741700 (+ 1706us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:34.742593 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.742609 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.745095 (+ 2486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.745101 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.747353 (+ 2252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.747367 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.748238 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.748246 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.748439 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.749159 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:34.749182 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:34.758529 (+ 9347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:34.763805 (+ 5276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:34.763811 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:34.763815 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:34.764817 (+ 1002us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:34.765490 (+ 673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:34.765495 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:34.765499 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:34.766855 (+ 1356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:34.768328 (+ 1473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:34.768334 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:34.770013 (+ 1679us) client_negotiation.cc:769] Sending connection context
0809 00:46:34.770218 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 00:46:34.770607 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21766,"thread_start_us":15008,"threads_started":1}
I20260809 00:46:34.772545 8380 heartbeater.cc:511] Master 127.28.92.188:46319 requested a full tablet report, sending...
I20260809 00:46:34.772750 8386 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36087
I20260809 00:46:34.772915 8386 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:34.773934 8386 heartbeater.cc:511] Master 127.28.92.190:36087 requested a full tablet report, sending...
Aug 09 00:46:34 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236394, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
I20260809 00:46:34.775497 6648 ts_manager.cc:194] Re-registered known tserver with Master: 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115)
I20260809 00:46:34.776398 8038 ts_manager.cc:194] Registered new tserver with Master: 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115)
I20260809 00:46:34.776998 6648 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:48557
I20260809 00:46:34.787709 8404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.732625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:43927 (local address 127.28.92.189:41241)
0809 00:46:34.745857 (+ 13232us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:34.745864 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:34.753416 (+ 7552us) server_negotiation.cc:407] Connection header received
0809 00:46:34.753492 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:34.753498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:34.753608 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:34.753778 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:34.756590 (+ 2812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.758158 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.760717 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.761561 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.762878 (+ 1317us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.779976 (+ 17098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:34.779985 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:34.779990 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:34.780033 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:34.783827 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.784778 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.784783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.784785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.784944 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:34.785986 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:34.785990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:34.785992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:34.786366 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:34.786498 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:34.787043 (+ 545us) server_negotiation.cc:299] Negotiation successful
0809 00:46:34.787303 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12995,"thread_start_us":13275,"threads_started":1}
I20260809 00:46:34.787833 8407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:34.738636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.28.92.129:43927)
0809 00:46:34.752912 (+ 14276us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:34.752933 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:34.753287 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:34.754233 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:34.754240 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:34.755415 (+ 1175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:34.756358 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.756376 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.758367 (+ 1991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.758372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.760538 (+ 2166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:34.760553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:34.761956 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:34.761965 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:34.762314 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:34.763330 (+ 1016us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:34.763352 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:34.779612 (+ 16260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:34.783982 (+ 4370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:34.783988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:34.783992 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:34.784650 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:34.785108 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:34.785115 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:34.785119 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:34.785369 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:34.786508 (+ 1139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:34.786514 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:34.786721 (+ 207us) client_negotiation.cc:769] Sending connection context
0809 00:46:34.786871 (+ 150us) client_negotiation.cc:240] Negotiation successful
0809 00:46:34.787246 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14106,"thread_start_us":13786,"threads_started":1}
I20260809 00:46:34.788864 8398 heartbeater.cc:347] Connected to a master server at 127.28.92.189:41241
I20260809 00:46:34.789033 8398 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:34.789866 8398 heartbeater.cc:511] Master 127.28.92.189:41241 requested a full tablet report, sending...
I20260809 00:46:34.792223 7720 ts_manager.cc:194] Registered new tserver with Master: 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115)
I20260809 00:46:34.858917 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 7007
I20260809 00:46:34.881855 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:38573
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:36087
--webserver_port=45607
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:46:34.909262 7963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: NON_VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: true } } }
I20260809 00:46:34.909808 7963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:34.911640 7963 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: attempting to promote NON_VOTER 0b839134fd4a42dfaa015e20fcd78375 to VOTER
I20260809 00:46:34.912463 7963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } }
I20260809 00:46:34.914690 7734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Refusing update from remote peer 223d2f0509f2472d8d6340b869bda3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 00:46:34.914992 8052 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 LEARNER]: Refusing update from remote peer 223d2f0509f2472d8d6340b869bda3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 00:46:34.915647 8414 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 00:46:34.916381 8413 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260809 00:46:34.919852 8414 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.920938 7734 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.925344 8413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.925814 8413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:34.925562 8414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.926209 8414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:34.930554 8418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.931531 8418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:46:34.934864 7963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.935274 7963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:34.935348 8052 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.939122 8420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "223d2f0509f2472d8d6340b869bda3f5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:34.939462 8420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 00:46:35.235682 8412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:35.235980 8412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:35.236078 8412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:35.243180 8412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:35.243284 8412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:35.243404 8412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:35.252815 8412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:38573
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=45607
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:35.254127 8412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:35.255412 8412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:35.268183 8427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:35.268224 8436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:35.268273 8428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:35.269407 8412 server_base.cc:1034] running on GCE node
I20260809 00:46:35.270129 8412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:35.271258 8412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:35.272516 8412 hybrid_clock.cc:648] HybridClock initialized: now 1786236395272435 us; error 66 us; skew 500 ppm
I20260809 00:46:35.272847 8412 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:35 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:35.275928 8412 init.cc:377] Logged in from keytab as oryx/127.28.92.130@KRBTEST.COM (short username oryx)
I20260809 00:46:35.277271 8412 webserver.cc:460] Webserver started at http://127.28.92.130:45607/ using document root <none> and password file <none>
I20260809 00:46:35.278028 8412 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:35.278160 8412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:35.283501 8412 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:46:35.286243 8467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:35.287578 8412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:35.287732 8412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "4fd22afd19fc468d819953bcab76ef57"
format_stamp: "Formatted at 2026-08-09 00:46:31 on dist-test-slave-t7g5"
server_key: "0fe462944967dab5b364944d0bd674ce"
server_key_iv: "9500636b5f2d5c7ef2b8a60198cde759"
server_key_version: "encryptionkey@0"
I20260809 00:46:35.288841 8412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:35.307204 8412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:35.311931 8412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:35.312220 8412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:35.313213 8412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:35.314631 8412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:35.314723 8412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:35.314833 8412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:35.314910 8412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:35.344889 8412 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:38573
I20260809 00:46:35.344978 8683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:38573 every 8 connection(s)
I20260809 00:46:35.346527 8412 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:35.354929 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 8412
I20260809 00:46:35.355255 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 7244
Aug 09 00:46:35 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
Aug 09 00:46:35 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
Aug 09 00:46:35 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.188@KRBTEST.COM
Aug 09 00:46:35 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.131@KRBTEST.COM
I20260809 00:46:35.418879 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.350123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.28.92.130:40825)
0809 00:46:35.386375 (+ 36252us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:35.386429 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:35.390778 (+ 4349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:35.392418 (+ 1640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:35.392433 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:35.393368 (+ 935us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:35.394413 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:35.394442 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.396279 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.396286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:35.399329 (+ 3043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:35.399348 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.400803 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.400813 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:35.401153 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.402370 (+ 1217us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:35.402414 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:35.405910 (+ 3496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:35.412250 (+ 6340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:35.412260 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:35.412280 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:35.412802 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:35.413447 (+ 645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:35.413453 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:35.413457 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:35.413940 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:35.414730 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:35.414741 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:35.415404 (+ 663us) client_negotiation.cc:769] Sending connection context
0809 00:46:35.415967 (+ 563us) client_negotiation.cc:240] Negotiation successful
0809 00:46:35.416733 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35920,"thread_start_us":35671,"threads_started":1}
I20260809 00:46:35.420449 8688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.349427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:40825 (local address 127.28.92.189:41241)
0809 00:46:35.385083 (+ 35656us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:35.385090 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:35.386881 (+ 1791us) server_negotiation.cc:407] Connection header received
0809 00:46:35.391178 (+ 4297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:35.391186 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:35.391318 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:35.391678 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:35.394679 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.396025 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.399534 (+ 3509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.400243 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.400400 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.406204 (+ 5804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:35.406212 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:35.406217 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:35.406292 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:35.412086 (+ 5794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.412958 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.412962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.412965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.413284 (+ 319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.414095 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.414101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.414105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.414571 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:35.414761 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:35.419502 (+ 4741us) server_negotiation.cc:299] Negotiation successful
0809 00:46:35.419836 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35506,"thread_start_us":35666,"threads_started":1}
I20260809 00:46:35.423662 8686 heartbeater.cc:347] Connected to a master server at 127.28.92.189:41241
I20260809 00:46:35.424189 8686 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:35.425143 8689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.349757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:39331 (local address 127.28.92.188:46319)
0809 00:46:35.384473 (+ 34716us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:35.384481 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:35.400278 (+ 15797us) server_negotiation.cc:407] Connection header received
0809 00:46:35.400549 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:35.400554 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:35.400647 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:35.400965 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:35.402811 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.403928 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.407691 (+ 3763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.408758 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.408908 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.416319 (+ 7411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:35.416329 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:35.416334 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:35.416387 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:35.420861 (+ 4474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.422370 (+ 1509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.422377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.422381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.422593 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.423266 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.423272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.423280 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.423700 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:35.423837 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:35.424450 (+ 613us) server_negotiation.cc:299] Negotiation successful
0809 00:46:35.424684 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34540,"thread_start_us":34766,"threads_started":1}
I20260809 00:46:35.425982 8686 heartbeater.cc:511] Master 127.28.92.189:41241 requested a full tablet report, sending...
I20260809 00:46:35.426481 8699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.350123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.28.92.130:39331)
0809 00:46:35.399983 (+ 49860us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:35.399998 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:35.400393 (+ 395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:35.401263 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:35.401267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:35.402132 (+ 865us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:35.402576 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:35.402590 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.404230 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.404237 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:35.407505 (+ 3268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:35.407522 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.409364 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.409374 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:35.409643 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.410971 (+ 1328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:35.411001 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:35.416054 (+ 5053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:35.421048 (+ 4994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:35.421053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:35.421057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:35.422197 (+ 1140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:35.422865 (+ 668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:35.422870 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:35.422874 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:35.423077 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:35.423916 (+ 839us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:35.423921 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:35.424120 (+ 199us) client_negotiation.cc:769] Sending connection context
0809 00:46:35.425348 (+ 1228us) client_negotiation.cc:240] Negotiation successful
0809 00:46:35.425686 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49719,"mutex_wait_us":36,"spinlock_wait_cycles":55680,"thread_start_us":51580,"threads_started":1}
I20260809 00:46:35.427304 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.387373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:59719 (local address 127.28.92.190:36087)
0809 00:46:35.398623 (+ 11250us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:35.398630 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:35.402443 (+ 3813us) server_negotiation.cc:407] Connection header received
0809 00:46:35.402787 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:35.402793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:35.402906 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:35.403327 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:35.405036 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.406227 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.408572 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.409273 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.409388 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.415279 (+ 5891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:35.415286 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:35.415290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:35.415362 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:35.421487 (+ 6125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.423420 (+ 1933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.423426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.423429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.423687 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.424433 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.424439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.424442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.424869 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:35.425013 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:35.426286 (+ 1273us) server_negotiation.cc:299] Negotiation successful
0809 00:46:35.426741 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11089,"thread_start_us":10955,"threads_started":1}
I20260809 00:46:35.427903 8684 heartbeater.cc:347] Connected to a master server at 127.28.92.188:46319
I20260809 00:46:35.428113 8684 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:35.428190 7720 ts_manager.cc:194] Registered new tserver with Master: 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:35.429064 8684 heartbeater.cc:511] Master 127.28.92.188:46319 requested a full tablet report, sending...
I20260809 00:46:35.429450 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.387652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:59719)
0809 00:46:35.401839 (+ 14187us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:35.402142 (+ 303us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:35.402584 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:35.403657 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:35.403663 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:35.404277 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:35.404819 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:35.404837 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.406430 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.406436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:35.408370 (+ 1934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:35.408390 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.409769 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.409782 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:35.410024 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.410638 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:35.410667 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:35.415018 (+ 4351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:35.421644 (+ 6626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:35.421680 (+ 36us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:35.421684 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:35.423257 (+ 1573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:35.423916 (+ 659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:35.423922 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:35.423925 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:35.424224 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:35.425080 (+ 856us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:35.425085 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:35.425493 (+ 408us) client_negotiation.cc:769] Sending connection context
0809 00:46:35.425629 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 00:46:35.425980 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14020,"thread_start_us":11989,"threads_started":1}
I20260809 00:46:35.429486 8696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.356599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48050 (local address 127.28.92.131:35485)
0809 00:46:35.397490 (+ 40891us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:35.397502 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:35.400205 (+ 2703us) server_negotiation.cc:407] Connection header received
0809 00:46:35.400433 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:35.400443 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:35.400708 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:35.401065 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:35.403541 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.405217 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.407894 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:35.409300 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:35.409413 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:35.417201 (+ 7788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:35.417219 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:35.417238 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:35.417283 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:35.424278 (+ 6995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.425464 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.425475 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.425478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.425814 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:35.426320 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:35.426337 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:35.426340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:35.426782 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:35.427170 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:35.428602 (+ 1432us) server_negotiation.cc:299] Negotiation successful
0809 00:46:35.428888 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40626,"thread_start_us":40899,"threads_started":1}
I20260809 00:46:35.430490 8685 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36087
I20260809 00:46:35.430691 8685 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:35.430761 8038 ts_manager.cc:194] Registered new tserver with Master: 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:35.431309 7474 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:35.431907 8685 heartbeater.cc:511] Master 127.28.92.190:36087 requested a full tablet report, sending...
I20260809 00:46:35.433064 6648 ts_manager.cc:194] Re-registered known tserver with Master: 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:35.434330 6648 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:59719
I20260809 00:46:35.519680 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 7244
I20260809 00:46:35.541427 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:35485
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:36087
--webserver_port=39663
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:46:35.780051 8386 heartbeater.cc:503] Master 127.28.92.190:36087 was elected leader, sending a full tablet report...
W20260809 00:46:35.878499 8703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:35.878793 8703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:35.878924 8703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:35.886329 8703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:35.886461 8703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:35.886623 8703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:35.896453 8703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:35485
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=39663
--tserver_master_addrs=127.28.92.190:36087,127.28.92.189:41241,127.28.92.188:46319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:35.898128 8703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:35.899600 8703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:35.912871 8710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:35.912936 8711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:35.912971 8714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:35.914062 8703 server_base.cc:1034] running on GCE node
I20260809 00:46:35.914705 8703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:35.915663 8703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:35.916858 8703 hybrid_clock.cc:648] HybridClock initialized: now 1786236395916807 us; error 42 us; skew 500 ppm
I20260809 00:46:35.917207 8703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:35 dist-test-slave-t7g5 krb5kdc[6584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:35.920368 8703 init.cc:377] Logged in from keytab as oryx/127.28.92.131@KRBTEST.COM (short username oryx)
I20260809 00:46:35.922000 8703 webserver.cc:460] Webserver started at http://127.28.92.131:39663/ using document root <none> and password file <none>
I20260809 00:46:35.922659 8703 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:35.922798 8703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:35.928505 8703 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 00:46:35.931231 8728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:35.932538 8703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:35.932688 8703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "9d7b997559ca472f89c4a20a9c992c46"
format_stamp: "Formatted at 2026-08-09 00:46:32 on dist-test-slave-t7g5"
server_key: "fd65e03e79a02e8a3fc30ea495292055"
server_key_iv: "978674d18aed4772a3b17a85080ce527"
server_key_version: "encryptionkey@0"
I20260809 00:46:35.933841 8703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:35.950255 8703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:35.954046 8703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:35.954303 8703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:35.955283 8703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:35.956668 8703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:35.956768 8703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:35.956877 8703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:35.956945 8703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:35.988963 8703 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:35485
I20260809 00:46:35.989022 8924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:35485 every 8 connection(s)
I20260809 00:46:35.990499 8703 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:35.994361 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 8703
Aug 09 00:46:36 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.189@KRBTEST.COM
Aug 09 00:46:36 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.188@KRBTEST.COM
Aug 09 00:46:36 dist-test-slave-t7g5 krb5kdc[6584](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236395, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:36.052945 8938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.994252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.28.92.131:51621)
0809 00:46:35.997399 (+ 3147us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:35.997464 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.018505 (+ 21041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.020870 (+ 2365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.020874 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.021596 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:36.022644 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.022674 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.024138 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.024143 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.027638 (+ 3495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.027657 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.030326 (+ 2669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.030337 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.030778 (+ 441us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.031894 (+ 1116us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:36.031931 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:36.037600 (+ 5669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:36.045992 (+ 8392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:36.045998 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:36.046001 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:36.046660 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:36.047358 (+ 698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:36.047363 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:36.047366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:36.047784 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:36.049112 (+ 1328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:36.049121 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:36.049724 (+ 603us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.050113 (+ 389us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.050869 (+ 756us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2835,"mutex_wait_us":62,"spinlock_wait_cycles":35584,"thread_start_us":2580,"threads_started":1}
I20260809 00:46:36.054885 8943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.994886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.28.92.131:58379)
0809 00:46:36.016089 (+ 21203us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.016117 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.018982 (+ 2865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.020259 (+ 1277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.020275 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.022706 (+ 2431us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:36.024598 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.024617 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.026500 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.026505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.030151 (+ 3646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.030168 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.031903 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.031909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.032082 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.032730 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:36.032752 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:36.038894 (+ 6142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:36.044985 (+ 6091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:36.044997 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:36.045019 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:36.046843 (+ 1824us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:36.047930 (+ 1087us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:36.047935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:36.047938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:36.048218 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:36.053405 (+ 5187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:36.053410 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:36.053668 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.053906 (+ 238us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.054198 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21033,"mutex_wait_us":84,"thread_start_us":22195,"threads_started":1}
I20260809 00:46:36.054934 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.993474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:51621 (local address 127.28.92.189:41241)
0809 00:46:35.996983 (+ 3509us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:35.996991 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:35.997572 (+ 581us) server_negotiation.cc:407] Connection header received
0809 00:46:36.018924 (+ 21352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.018932 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.019034 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.019179 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.022888 (+ 3709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.023932 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.027797 (+ 3865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.028591 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.028743 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.038028 (+ 9285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.038036 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.038042 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.038140 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.045594 (+ 7454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.046805 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.046811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.046814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.047007 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.048540 (+ 1533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.048545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.048549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.048920 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.049051 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.054179 (+ 5128us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.054432 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3366,"thread_start_us":3244,"threads_started":1}
I20260809 00:46:36.055501 8937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.993610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:58379 (local address 127.28.92.188:46319)
0809 00:46:36.002069 (+ 8459us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.002077 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.016272 (+ 14195us) server_negotiation.cc:407] Connection header received
0809 00:46:36.019392 (+ 3120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.019400 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.019489 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.019694 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.024835 (+ 5141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.026261 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.030560 (+ 4299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.031315 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.031425 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.039160 (+ 7735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.039169 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.039173 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.039215 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.044776 (+ 5561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.046974 (+ 2198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.046979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.046982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.047202 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.048354 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.048359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.048363 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.048894 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.049031 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.054097 (+ 5066us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.054382 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8324,"thread_start_us":8162,"threads_started":1}
I20260809 00:46:36.056376 8930 heartbeater.cc:347] Connected to a master server at 127.28.92.189:41241
I20260809 00:46:36.056825 8930 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:36.057355 8926 heartbeater.cc:347] Connected to a master server at 127.28.92.188:46319
I20260809 00:46:36.057544 8926 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:36.058676 8930 heartbeater.cc:511] Master 127.28.92.189:41241 requested a full tablet report, sending...
I20260809 00:46:36.060112 8926 heartbeater.cc:511] Master 127.28.92.188:46319 requested a full tablet report, sending...
I20260809 00:46:36.060770 7720 ts_manager.cc:194] Registered new tserver with Master: 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131:35485)
I20260809 00:46:36.061646 8038 ts_manager.cc:194] Registered new tserver with Master: 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131:35485)
I20260809 00:46:36.062731 8944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.007719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49600 (local address 127.28.92.190:36087)
0809 00:46:36.020783 (+ 13064us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.020788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.022942 (+ 2154us) server_negotiation.cc:407] Connection header received
0809 00:46:36.023127 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.023133 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.023203 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.023276 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.027129 (+ 3853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.029164 (+ 2035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.035506 (+ 6342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.036871 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.036997 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.048470 (+ 11473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.048479 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.048484 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.048534 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.055385 (+ 6851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.058190 (+ 2805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.058196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.058199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.058478 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.059099 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.059104 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.059108 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.059614 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.059943 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.061265 (+ 1322us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.062261 (+ 996us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12969,"thread_start_us":11534,"threads_started":1}
I20260809 00:46:36.069340 8939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.998192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:34429)
0809 00:46:36.016964 (+ 18772us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.016984 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.019072 (+ 2088us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.020260 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.020275 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.021736 (+ 1461us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:36.023029 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.023041 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.027872 (+ 4831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.027878 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.031625 (+ 3747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.031642 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.033923 (+ 2281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.033933 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.034189 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.037844 (+ 3655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:36.037866 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:36.055752 (+ 17886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:36.065068 (+ 9316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:36.065074 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:36.065078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:36.065614 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:36.066660 (+ 1046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:36.066666 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:36.066669 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:36.067019 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:36.067838 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:36.067844 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:36.068055 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.068281 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.068591 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18659,"mutex_wait_us":2007,"thread_start_us":18127,"threads_started":1}
I20260809 00:46:36.070715 8950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:35.998320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:34429 (local address 127.28.92.190:36087)
0809 00:46:36.019506 (+ 21186us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.019514 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.019536 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:46:36.019608 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.019613 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.019696 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.019809 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.023430 (+ 3621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.024518 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.031771 (+ 7253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.032876 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.033002 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.056030 (+ 23028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.056038 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.056042 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.056083 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.062040 (+ 5957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.065765 (+ 3725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.065771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.065774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.066008 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.067201 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.067206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.067210 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.067691 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.067915 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.069855 (+ 1940us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.070094 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21033,"thread_start_us":22245,"threads_started":1}
I20260809 00:46:36.071666 8927 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36087
I20260809 00:46:36.071888 8927 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:36.072894 8927 heartbeater.cc:511] Master 127.28.92.190:36087 requested a full tablet report, sending...
I20260809 00:46:36.074426 6649 ts_manager.cc:194] Re-registered known tserver with Master: 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131:35485)
I20260809 00:46:36.075721 8956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.008256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34904 (local address 127.28.92.188:46319)
0809 00:46:36.018071 (+ 9815us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.018077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.028626 (+ 10549us) server_negotiation.cc:407] Connection header received
0809 00:46:36.028940 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.028945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.029079 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.029232 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.044755 (+ 15523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.047191 (+ 2436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.051290 (+ 4099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.052370 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.052481 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.066823 (+ 14342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.066832 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.066836 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.066879 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.071498 (+ 4619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.072410 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.072418 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.072421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.072672 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.073289 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.073295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.073298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.073731 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.073994 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.074813 (+ 819us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.075086 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9678,"thread_start_us":9543,"threads_started":1}
I20260809 00:46:36.075917 6649 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:34429
I20260809 00:46:36.080000 8961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.030003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42890 (local address 127.28.92.189:41241)
0809 00:46:36.050856 (+ 20853us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.050863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.050882 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:46:36.050935 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.050941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.051020 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.051174 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.056577 (+ 5403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.059169 (+ 2592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.062626 (+ 3457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.063368 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.063482 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.068275 (+ 4793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.068285 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.068290 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.068329 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.076190 (+ 7861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.077165 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.077170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.077173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.077405 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.077974 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.077978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.077981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.078489 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.078871 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.079211 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.079452 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20686,"thread_start_us":21110,"threads_started":1}
I20260809 00:46:36.068799 6648 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49600:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:36.082990 6648 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:36.138911 8983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.111086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:42115 (local address 127.0.0.1:48450)
0809 00:46:36.112783 (+ 1697us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.112808 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.113213 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.128508 (+ 15295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.128513 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.128538 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:36.129616 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.129633 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.132312 (+ 2679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.132322 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.135538 (+ 3216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.135555 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.137319 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.137327 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.137594 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.137621 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.137731 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.137866 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1450,"mutex_wait_us":4,"thread_start_us":1019,"threads_started":1}
I20260809 00:46:36.139037 8987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.111368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48450 (local address 127.28.92.129:42115)
0809 00:46:36.127564 (+ 16196us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.127573 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.127604 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:46:36.127706 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.127713 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.128005 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.128640 (+ 635us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:36.129967 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.132146 (+ 2179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.135728 (+ 3582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.136901 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.137136 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.137409 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.138378 (+ 969us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.138651 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15968,"thread_start_us":14464,"threads_started":1}
I20260809 00:46:36.139775 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.113466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37838 (local address 127.28.92.130:38573)
0809 00:46:36.115170 (+ 1704us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.115182 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.127108 (+ 11926us) server_negotiation.cc:407] Connection header received
0809 00:46:36.127359 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.127369 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.127671 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.128182 (+ 511us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:36.130184 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.131521 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.135729 (+ 4208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.137630 (+ 1901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.137923 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.138181 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.138989 (+ 808us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.139400 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1230,"thread_start_us":1370,"threads_started":1}
I20260809 00:46:36.140141 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.112543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:38573 (local address 127.0.0.1:37838)
0809 00:46:36.126766 (+ 14223us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.126818 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.127159 (+ 341us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.128165 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.128170 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.128197 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:36.130017 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.130029 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.131675 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.131681 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.135587 (+ 3906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.135597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.137991 (+ 2394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.137998 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.138726 (+ 728us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.138763 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.138892 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.139030 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14068,"mutex_wait_us":52,"thread_start_us":13842,"threads_started":1}
I20260809 00:46:36.141880 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.112797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48054 (local address 127.28.92.131:35485)
0809 00:46:36.124379 (+ 11582us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.124392 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.126082 (+ 1690us) server_negotiation.cc:407] Connection header received
0809 00:46:36.126528 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.126538 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.126805 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.127228 (+ 423us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:36.129767 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.132106 (+ 2339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.135428 (+ 3322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.138018 (+ 2590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.138145 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.138428 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.140479 (+ 2051us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.140728 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11221,"thread_start_us":9904,"threads_started":1}
I20260809 00:46:36.143960 8558 tablet_service.cc:1467] Processing CreateTablet for tablet c12d1a18ed5340f9978f8a35e66333ba (DEFAULT_TABLE table=test-table [id=47d207eb7e884773a63c5bd4daf83060]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:36.143985 8246 tablet_service.cc:1467] Processing CreateTablet for tablet c12d1a18ed5340f9978f8a35e66333ba (DEFAULT_TABLE table=test-table [id=47d207eb7e884773a63c5bd4daf83060]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:36.145320 8558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c12d1a18ed5340f9978f8a35e66333ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:36.145517 8246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c12d1a18ed5340f9978f8a35e66333ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:36.146472 8989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.111881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:35485 (local address 127.0.0.1:48054)
0809 00:46:36.125620 (+ 13739us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.125701 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.126264 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.127222 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.127227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.127254 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:36.129470 (+ 2216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.129485 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.132388 (+ 2903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.132395 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.135269 (+ 2874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.135285 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.139999 (+ 4714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.140012 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.140258 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.140298 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.140381 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.140514 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13550,"mutex_wait_us":21,"thread_start_us":13280,"threads_started":1}
I20260809 00:46:36.151665 8817 tablet_service.cc:1467] Processing CreateTablet for tablet c12d1a18ed5340f9978f8a35e66333ba (DEFAULT_TABLE table=test-table [id=47d207eb7e884773a63c5bd4daf83060]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:36.153738 8817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c12d1a18ed5340f9978f8a35e66333ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:36.172724 8995 tablet_bootstrap.cc:492] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Bootstrap starting.
I20260809 00:46:36.181970 8995 tablet_bootstrap.cc:654] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:36.184841 8997 tablet_bootstrap.cc:492] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Bootstrap starting.
I20260809 00:46:36.185288 8995 log.cc:824] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:36.187698 8998 tablet_bootstrap.cc:492] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Bootstrap starting.
I20260809 00:46:36.192359 8997 tablet_bootstrap.cc:654] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:36.193589 8995 tablet_bootstrap.cc:492] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: No bootstrap required, opened a new log
I20260809 00:46:36.194139 8995 ts_tablet_manager.cc:1397] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.013s
I20260809 00:46:36.194381 8998 tablet_bootstrap.cc:654] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:36.195140 8997 log.cc:824] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:36.197175 8998 log.cc:824] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:36.202818 8997 tablet_bootstrap.cc:492] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: No bootstrap required, opened a new log
I20260809 00:46:36.203307 8997 ts_tablet_manager.cc:1397] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20260809 00:46:36.203472 8998 tablet_bootstrap.cc:492] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: No bootstrap required, opened a new log
I20260809 00:46:36.203902 8998 ts_tablet_manager.cc:1397] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260809 00:46:36.209431 8995 raft_consensus.cc:348] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.210098 8995 raft_consensus.cc:374] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:36.210294 8995 raft_consensus.cc:729] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bfcac3cc5449249643646b85a1530c, State: Initialized, Role: FOLLOWER
I20260809 00:46:36.211185 8995 consensus_queue.cc:260] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.220522 8997 raft_consensus.cc:348] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.220477 8998 raft_consensus.cc:348] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.221026 8998 raft_consensus.cc:374] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:36.221043 8997 raft_consensus.cc:374] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:36.221145 8997 raft_consensus.cc:729] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7b997559ca472f89c4a20a9c992c46, State: Initialized, Role: FOLLOWER
I20260809 00:46:36.221201 8998 raft_consensus.cc:729] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd22afd19fc468d819953bcab76ef57, State: Initialized, Role: FOLLOWER
I20260809 00:46:36.222093 8998 consensus_queue.cc:260] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.222896 8997 consensus_queue.cc:260] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.223596 8995 ts_tablet_manager.cc:1428] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Time spent starting tablet: real 0.029s user 0.013s sys 0.013s
I20260809 00:46:36.226853 8997 ts_tablet_manager.cc:1428] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Time spent starting tablet: real 0.023s user 0.009s sys 0.014s
I20260809 00:46:36.228868 8927 heartbeater.cc:503] Master 127.28.92.190:36087 was elected leader, sending a full tablet report...
I20260809 00:46:36.233704 8998 ts_tablet_manager.cc:1428] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Time spent starting tablet: real 0.030s user 0.022s sys 0.004s
I20260809 00:46:36.233945 8685 heartbeater.cc:503] Master 127.28.92.190:36087 was elected leader, sending a full tablet report...
W20260809 00:46:36.247807 8400 tablet.cc:2369] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:46:36.249290 8932 tablet.cc:2369] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:36.259407 9010 raft_consensus.cc:482] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:36.259917 9010 raft_consensus.cc:504] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.262594 9010 leader_election.cc:288] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115), 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:36.270756 8993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.263380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:59697 (local address 127.28.92.130:38573)
0809 00:46:36.263634 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.263639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.263658 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:46:36.263726 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.263731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.263790 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.263863 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:36.264277 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.265186 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.268185 (+ 2999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.269876 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.270047 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.270125 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.270426 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.270536 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 00:46:36.270982 8943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.263244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:38573 (local address 127.28.92.131:59697)
0809 00:46:36.263512 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.263528 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.263626 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.263904 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.263909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.263932 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:36.264142 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.264151 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.265386 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.265391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.268005 (+ 2614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.268021 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.270019 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.270023 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.270247 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.270283 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.270386 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.270565 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":39}
I20260809 00:46:36.271482 8987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.262874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:40439 (local address 127.28.92.129:42115)
0809 00:46:36.263088 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.263094 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.263120 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:46:36.263265 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.263270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.263339 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.263435 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:36.264045 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.264896 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.268219 (+ 3323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.270168 (+ 1949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.270284 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.270334 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.271093 (+ 759us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.271228 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 00:46:36.271694 8939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.262738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:42115 (local address 127.28.92.131:40439)
0809 00:46:36.262963 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:36.262985 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:36.263107 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:36.263488 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:36.263493 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:36.263522 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:36.263894 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.263906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.265072 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.265075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.268039 (+ 2964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:36.268048 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.270398 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.270405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:36.270830 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.270870 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 00:46:36.271013 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 00:46:36.271145 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":41,"spinlock_wait_cycles":2816}
I20260809 00:46:36.272104 8589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12d1a18ed5340f9978f8a35e66333ba" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd22afd19fc468d819953bcab76ef57" is_pre_election: true
I20260809 00:46:36.272835 8298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12d1a18ed5340f9978f8a35e66333ba" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bfcac3cc5449249643646b85a1530c" is_pre_election: true
I20260809 00:46:36.273191 8589 raft_consensus.cc:2454] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 0.
I20260809 00:46:36.273559 8298 raft_consensus.cc:2454] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 0.
I20260809 00:46:36.274358 8736 leader_election.cc:302] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd22afd19fc468d819953bcab76ef57, 9d7b997559ca472f89c4a20a9c992c46; no voters:
I20260809 00:46:36.274834 9010 raft_consensus.cc:2781] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:36.275102 9010 raft_consensus.cc:482] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:36.275286 9010 raft_consensus.cc:3037] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:36.278403 9010 raft_consensus.cc:504] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.279280 9010 leader_election.cc:288] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 election: Requested vote from peers 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115), 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:36.279789 8298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12d1a18ed5340f9978f8a35e66333ba" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bfcac3cc5449249643646b85a1530c"
I20260809 00:46:36.279871 8589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c12d1a18ed5340f9978f8a35e66333ba" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd22afd19fc468d819953bcab76ef57"
I20260809 00:46:36.280054 8298 raft_consensus.cc:3037] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:36.280131 8589 raft_consensus.cc:3037] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:36.283870 8298 raft_consensus.cc:2454] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 1.
I20260809 00:46:36.284279 8589 raft_consensus.cc:2454] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 1.
I20260809 00:46:36.284427 8736 leader_election.cc:302] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33bfcac3cc5449249643646b85a1530c, 9d7b997559ca472f89c4a20a9c992c46; no voters:
I20260809 00:46:36.284869 9010 raft_consensus.cc:2781] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:36.285953 9010 raft_consensus.cc:686] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 1 LEADER]: Becoming Leader. State: Replica: 9d7b997559ca472f89c4a20a9c992c46, State: Running, Role: LEADER
I20260809 00:46:36.286751 9010 consensus_queue.cc:237] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } }
I20260809 00:46:36.293541 6649 catalog_manager.cc:5495] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "9d7b997559ca472f89c4a20a9c992c46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } health_report { overall_health: HEALTHY } } }
I20260809 00:46:36.319473 8992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.312824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48070 (local address 127.28.92.131:35485)
0809 00:46:36.313023 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.313028 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.313048 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:46:36.313140 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.313145 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.313237 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.313371 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:36.313888 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.314964 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.316718 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.317388 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.317498 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.318261 (+ 763us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:36.318797 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:36.318926 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.318967 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.319038 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:46:36.331363 8589 raft_consensus.cc:1261] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Refusing update from remote peer 9d7b997559ca472f89c4a20a9c992c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:36.331388 8298 raft_consensus.cc:1261] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Refusing update from remote peer 9d7b997559ca472f89c4a20a9c992c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:36.332471 9011 consensus_queue.cc:1035] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:36.333132 9010 consensus_queue.cc:1035] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:36.355425 9021 mvcc.cc:205] Tried to move back new op lower bound from 7316424279361019904 to 7316424279195246592. Current Snapshot: MvccSnapshot[applied={T|T < 7316424279361019904}]
I20260809 00:46:36.391521 6649 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:36.392033 6649 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49600:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:36.401259 6649 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 223d2f0509f2472d8d6340b869bda3f5: Sending DeleteTablet for 3 replicas of tablet c12d1a18ed5340f9978f8a35e66333ba
I20260809 00:46:36.402801 8817 tablet_service.cc:1514] Processing DeleteTablet for tablet c12d1a18ed5340f9978f8a35e66333ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:36 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:48054
I20260809 00:46:36.402894 8246 tablet_service.cc:1514] Processing DeleteTablet for tablet c12d1a18ed5340f9978f8a35e66333ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:36 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:48450
I20260809 00:46:36.403388 8558 tablet_service.cc:1514] Processing DeleteTablet for tablet c12d1a18ed5340f9978f8a35e66333ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:36 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:37838
I20260809 00:46:36.404762 9035 tablet_replica.cc:330] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: stopping tablet replica
I20260809 00:46:36.405395 9035 raft_consensus.cc:2229] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:36.406666 9035 raft_consensus.cc:2258] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:36.409053 9035 ts_tablet_manager.cc:1905] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:36.409976 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 6602
I20260809 00:46:36.421037 9035 ts_tablet_manager.cc:1918] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:36.421490 9035 log.cc:1196] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/c12d1a18ed5340f9978f8a35e66333ba
I20260809 00:46:36.422106 6702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:36.422431 9041 tablet_replica.cc:330] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: stopping tablet replica
I20260809 00:46:36.422801 9035 ts_tablet_manager.cc:1939] T c12d1a18ed5340f9978f8a35e66333ba P 9d7b997559ca472f89c4a20a9c992c46: Deleting consensus metadata
I20260809 00:46:36.423080 9041 raft_consensus.cc:2229] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:36.424017 9041 raft_consensus.cc:2258] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:36.431473 9041 ts_tablet_manager.cc:1905] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:36.432488 9039 tablet_replica.cc:330] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: stopping tablet replica
I20260809 00:46:36.433038 9039 raft_consensus.cc:2229] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:36.433972 9039 raft_consensus.cc:2258] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:36.436476 9039 ts_tablet_manager.cc:1905] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:36.440250 9041 ts_tablet_manager.cc:1918] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:36.440541 9041 log.cc:1196] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/c12d1a18ed5340f9978f8a35e66333ba
I20260809 00:46:36.441282 9041 ts_tablet_manager.cc:1939] T c12d1a18ed5340f9978f8a35e66333ba P 4fd22afd19fc468d819953bcab76ef57: Deleting consensus metadata
I20260809 00:46:36.445785 9039 ts_tablet_manager.cc:1918] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:36.445992 9039 log.cc:1196] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/c12d1a18ed5340f9978f8a35e66333ba
I20260809 00:46:36.446858 9039 ts_tablet_manager.cc:1939] T c12d1a18ed5340f9978f8a35e66333ba P 33bfcac3cc5449249643646b85a1530c: Deleting consensus metadata
I20260809 00:46:36.452783 8961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.409015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.28.92.189:41241)
0809 00:46:36.409196 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.409202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.420141 (+ 10939us) server_negotiation.cc:407] Connection header received
0809 00:46:36.424817 (+ 4676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.424823 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.424977 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.425059 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.429087 (+ 4028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.430542 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.433175 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.434183 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.434342 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.442920 (+ 8578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.442928 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.442934 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.442986 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.448536 (+ 5550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.449784 (+ 1248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.449790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.449794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.450066 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.450848 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.450853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.450857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.451308 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.451581 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.452156 (+ 575us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.452411 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:46:36.474784 8956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.421351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34906 (local address 127.28.92.188:46319)
0809 00:46:36.422744 (+ 1393us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.422753 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.453005 (+ 30252us) server_negotiation.cc:407] Connection header received
0809 00:46:36.454170 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.454178 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.454269 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.454363 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.457411 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.458634 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.460558 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.461602 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.461805 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.465930 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.465937 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.465942 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.465986 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.470905 (+ 4919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.471826 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.471832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.471836 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.472075 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.472671 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.472676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.472680 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.473158 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.473511 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.473949 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.474223 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1125}
I20260809 00:46:36.577436 6632 catalog_manager.cc:4841] TS 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131:35485): tablet c12d1a18ed5340f9978f8a35e66333ba (table test-table [id=47d207eb7e884773a63c5bd4daf83060]) successfully deleted
I20260809 00:46:36.577854 6631 catalog_manager.cc:4841] TS 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115): tablet c12d1a18ed5340f9978f8a35e66333ba (table test-table [id=47d207eb7e884773a63c5bd4daf83060]) successfully deleted
I20260809 00:46:36.578097 6631 catalog_manager.cc:4841] TS 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573): tablet c12d1a18ed5340f9978f8a35e66333ba (table test-table [id=47d207eb7e884773a63c5bd4daf83060]) successfully deleted
I20260809 00:46:36.578634 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 6602
I20260809 00:46:36.642319 8956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.618921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34914 (local address 127.28.92.188:46319)
0809 00:46:36.619121 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.619127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.620053 (+ 926us) server_negotiation.cc:407] Connection header received
0809 00:46:36.620343 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.620351 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.620455 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.620533 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.624265 (+ 3732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.625635 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.628020 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.628709 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.628815 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.633074 (+ 4259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.633083 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.633088 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.633144 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.638305 (+ 5161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.639468 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.639475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.639479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.639671 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.640185 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.640191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.640194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.640642 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.640880 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.641637 (+ 757us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.641931 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:46:36.658165 8961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:36.619764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.28.92.189:41241)
0809 00:46:36.619957 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:36.619963 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:36.643471 (+ 23508us) server_negotiation.cc:407] Connection header received
0809 00:46:36.643744 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:36.643750 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:36.643844 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:36.643917 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:36.646018 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.647247 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.649885 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:36.650420 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:36.650522 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:36.653138 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:36.653143 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:36.653146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:36.653179 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:36.655708 (+ 2529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.656328 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.656332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.656334 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.656458 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:36.656804 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:36.656807 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:36.656809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:36.657094 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:36.657323 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:36.657620 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 00:46:36.657863 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:46:37.357864 9058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.357044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:34479)
0809 00:46:37.357538 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.357698 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":249,"threads_started":1}
W20260809 00:46:37.358381 8685 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:36087 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.375813 9061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.375022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:45841)
0809 00:46:37.375496 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.375624 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":233,"threads_started":1}
W20260809 00:46:37.376202 8927 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:36087 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.381933 9063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.381150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:32801)
0809 00:46:37.381573 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.381743 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":210,"threads_started":1}
W20260809 00:46:37.382293 8386 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:36087 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.900265 9066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 223d2f0509f2472d8d6340b869bda3f5)
I20260809 00:46:37.900584 9066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } }
I20260809 00:46:37.902177 9066 leader_election.cc:288] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087), 464d927f6d404c2c8d5303862ada4e28 (127.28.92.189:41241)
I20260809 00:46:37.903199 9073 raft_consensus.cc:482] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 223d2f0509f2472d8d6340b869bda3f5)
I20260809 00:46:37.903393 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.902317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:49988)
0809 00:46:37.902849 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.903078 (+ 229us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":266,"threads_started":1}
I20260809 00:46:37.903574 9073 raft_consensus.cc:504] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } }
W20260809 00:46:37.904536 8017 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.905956 9073 leader_election.cc:288] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087), 0b839134fd4a42dfaa015e20fcd78375 (127.28.92.188:46319)
I20260809 00:46:37.907011 9075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.906374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50000)
0809 00:46:37.906576 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.906797 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 00:46:37.907243 8017 leader_election.cc:334] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087): Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.907995 9079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.905309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:49994)
0809 00:46:37.907602 (+ 2293us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.907755 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":387,"threads_started":1}
W20260809 00:46:37.908232 7695 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.911226 9080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.909611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50016)
0809 00:46:37.910785 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.911002 (+ 217us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1054}
W20260809 00:46:37.911486 7695 leader_election.cc:334] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087): Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.912091 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.903025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41241 (local address 127.0.0.1:42910)
0809 00:46:37.903791 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.903811 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:37.903961 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:37.905399 (+ 1438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:37.905404 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:37.905433 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:37.905690 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.905704 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.907356 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.907363 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.909515 (+ 2152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.909535 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.911237 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.911244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.911454 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.911490 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:46:37.911625 (+ 135us) client_negotiation.cc:240] Negotiation successful
0809 00:46:37.911771 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":4,"thread_start_us":1180,"threads_started":1}
I20260809 00:46:37.912173 9076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.903219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.28.92.189:41241)
0809 00:46:37.904794 (+ 1575us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:37.904800 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:37.904822 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:46:37.904896 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:37.904900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:37.904985 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:37.905373 (+ 388us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:37.905909 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.907125 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.909748 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.911073 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.911196 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.911294 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:37.911662 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 00:46:37.911803 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1443,"thread_start_us":1243,"threads_started":1}
I20260809 00:46:37.912948 7734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b839134fd4a42dfaa015e20fcd78375" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "464d927f6d404c2c8d5303862ada4e28" is_pre_election: true
I20260809 00:46:37.913324 7734 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b839134fd4a42dfaa015e20fcd78375 in term 1.
I20260809 00:46:37.913877 8017 leader_election.cc:302] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b839134fd4a42dfaa015e20fcd78375, 464d927f6d404c2c8d5303862ada4e28; no voters: 223d2f0509f2472d8d6340b869bda3f5
I20260809 00:46:37.914318 9066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 00:46:37.914465 9066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 223d2f0509f2472d8d6340b869bda3f5)
I20260809 00:46:37.914567 9066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 1 FOLLOWER]: Advancing to term 2
I20260809 00:46:37.915932 9079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.906187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:46319 (local address 127.0.0.1:34918)
0809 00:46:37.909159 (+ 2972us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.909177 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:37.909317 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:37.909959 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:37.909964 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:37.909996 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:37.910266 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.910274 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.911763 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.911768 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.913715 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.913731 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.915324 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.915329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.915468 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.915505 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:46:37.915581 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 00:46:37.915682 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2876,"thread_start_us":4319,"threads_started":1}
I20260809 00:46:37.916165 9081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.906336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34918 (local address 127.28.92.188:46319)
0809 00:46:37.906888 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:37.906892 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:37.909443 (+ 2551us) server_negotiation.cc:407] Connection header received
0809 00:46:37.909526 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:37.909530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:37.909602 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:37.909765 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:37.910426 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.911618 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.913872 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.915159 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.915285 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.915400 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:37.915629 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 00:46:37.915788 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":297,"threads_started":1}
I20260809 00:46:37.916752 8052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "464d927f6d404c2c8d5303862ada4e28" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0b839134fd4a42dfaa015e20fcd78375" is_pre_election: true
I20260809 00:46:37.917621 9066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } }
I20260809 00:46:37.918092 8052 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 464d927f6d404c2c8d5303862ada4e28 in current term 2: Already voted for candidate 0b839134fd4a42dfaa015e20fcd78375 in this term.
I20260809 00:46:37.918350 9066 leader_election.cc:288] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [CANDIDATE]: Term 2 election: Requested vote from peers 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087), 464d927f6d404c2c8d5303862ada4e28 (127.28.92.189:41241)
I20260809 00:46:37.918910 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.918512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50028)
0809 00:46:37.918641 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.918716 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 00:46:37.919154 7734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0b839134fd4a42dfaa015e20fcd78375" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "464d927f6d404c2c8d5303862ada4e28"
I20260809 00:46:37.919430 7734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 1 FOLLOWER]: Advancing to term 2
I20260809 00:46:37.919772 7689 leader_election.cc:302] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 464d927f6d404c2c8d5303862ada4e28; no voters: 0b839134fd4a42dfaa015e20fcd78375, 223d2f0509f2472d8d6340b869bda3f5
I20260809 00:46:37.921022 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.920701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50030)
0809 00:46:37.920838 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.920909 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 00:46:37.921177 8017 leader_election.cc:334] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087): Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
I20260809 00:46:37.922251 7734 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b839134fd4a42dfaa015e20fcd78375 in term 2.
I20260809 00:46:37.922421 9073 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 00:46:37.922662 8017 leader_election.cc:302] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b839134fd4a42dfaa015e20fcd78375, 464d927f6d404c2c8d5303862ada4e28; no voters: 223d2f0509f2472d8d6340b869bda3f5
I20260809 00:46:37.922951 9066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 00:46:37.923374 9066 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [term 2 LEADER]: Becoming Leader. State: Replica: 0b839134fd4a42dfaa015e20fcd78375, State: Running, Role: LEADER
I20260809 00:46:37.923753 9066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } }
I20260809 00:46:37.925604 9083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b839134fd4a42dfaa015e20fcd78375. Latest consensus state: current_term: 2 leader_uuid: "0b839134fd4a42dfaa015e20fcd78375" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:37.926059 9083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:37.926741 9088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:37.930787 9088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:37.931609 9088 catalog_manager.cc:1259] Loaded cluster ID: 03ec1d7e74a64fd1a6736a685882aa74
I20260809 00:46:37.931681 9088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:37.932819 9088 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:37.933580 9088 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Loaded TSK: 0
I20260809 00:46:37.934510 9088 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:46:37.944940 8038 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:37.951985 8038 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:37.956264 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.955834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50044)
0809 00:46:37.956008 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.956117 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 00:46:37.956650 7734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [term 2 FOLLOWER]: Refusing update from remote peer 0b839134fd4a42dfaa015e20fcd78375: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260809 00:46:37.957244 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.956872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50056)
0809 00:46:37.956994 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.957099 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 00:46:37.957429 8017 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 -> Peer 223d2f0509f2472d8d6340b869bda3f5 (127.28.92.190:36087): Couldn't send request to peer 223d2f0509f2472d8d6340b869bda3f5. Status: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 00:46:37.957537 9066 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [LEADER]: Connected to new peer: Peer: permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 00:46:37.960295 9073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b839134fd4a42dfaa015e20fcd78375. Latest consensus state: current_term: 2 leader_uuid: "0b839134fd4a42dfaa015e20fcd78375" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:37.960569 9073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:46:37.961930 9066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "0b839134fd4a42dfaa015e20fcd78375" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:37.962312 9066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375 [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:37.962713 9073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "0b839134fd4a42dfaa015e20fcd78375" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "223d2f0509f2472d8d6340b869bda3f5" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36087 } } peers { permanent_uuid: "464d927f6d404c2c8d5303862ada4e28" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41241 } attrs { promote: false } } peers { permanent_uuid: "0b839134fd4a42dfaa015e20fcd78375" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 46319 } attrs { promote: false } } }
I20260809 00:46:37.962985 9073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 464d927f6d404c2c8d5303862ada4e28 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:46:37.985138 9072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.969957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:42115 (local address 127.0.0.1:48454)
0809 00:46:37.970106 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.970122 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:37.970205 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:37.976907 (+ 6702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:37.976914 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:37.976947 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:37.977186 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.977197 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.980481 (+ 3284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.980487 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.982426 (+ 1939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.982440 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.984098 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.984104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.984333 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.984377 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 00:46:37.984449 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 00:46:37.984605 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 00:46:37.986299 9097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.970035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48454 (local address 127.28.92.129:42115)
0809 00:46:37.970472 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:37.970479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:37.970500 (+ 21us) server_negotiation.cc:407] Connection header received
0809 00:46:37.970577 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:37.970583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:37.970661 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:37.977431 (+ 6770us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:37.977621 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.979146 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.982645 (+ 3499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.983891 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.985415 (+ 1524us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.985543 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:37.985600 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 00:46:37.985960 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":215,"threads_started":1}
I20260809 00:46:37.987069 8246 tablet_service.cc:1467] Processing CreateTablet for tablet 2502b443300e426bb881ebedd04bc45c (DEFAULT_TABLE table=test-table [id=e58517b6e4074b5181d78efe27de020d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:37.987598 8246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2502b443300e426bb881ebedd04bc45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:37.989214 9075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.970726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:35485 (local address 127.0.0.1:48086)
0809 00:46:37.971074 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.971089 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:37.971177 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:37.981460 (+ 10283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:37.981466 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:37.981492 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:37.981805 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.981817 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.984664 (+ 2847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.984668 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.987162 (+ 2494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.987175 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.988531 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.988537 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.988690 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.988715 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 00:46:37.988795 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:46:37.988933 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255}
I20260809 00:46:37.989310 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.970927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48086 (local address 127.28.92.131:35485)
0809 00:46:37.980513 (+ 9586us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:37.980519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:37.980538 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:46:37.980607 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:37.980612 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:37.980689 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:37.981980 (+ 1291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:37.982180 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.983182 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.987364 (+ 4182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.988328 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.988468 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.988597 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:37.988848 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 00:46:37.988990 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9462,"thread_start_us":9364,"threads_started":1}
I20260809 00:46:37.994315 8817 tablet_service.cc:1467] Processing CreateTablet for tablet 2502b443300e426bb881ebedd04bc45c (DEFAULT_TABLE table=test-table [id=e58517b6e4074b5181d78efe27de020d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:37.994846 8817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2502b443300e426bb881ebedd04bc45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:37.996618 9103 tablet_bootstrap.cc:492] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Bootstrap starting.
I20260809 00:46:37.998483 9103 tablet_bootstrap.cc:654] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:37.999454 9101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.972027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37852 (local address 127.28.92.130:38573)
0809 00:46:37.984363 (+ 12336us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:37.984370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:37.985137 (+ 767us) server_negotiation.cc:407] Connection header received
0809 00:46:37.985742 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:37.985748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:37.985834 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:37.985913 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:37.988212 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.994496 (+ 6284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.996139 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.998346 (+ 2207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.998492 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.998693 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:37.999013 (+ 320us) server_negotiation.cc:299] Negotiation successful
0809 00:46:37.999167 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12176,"thread_start_us":12347,"threads_started":1}
I20260809 00:46:37.999465 9099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:37.971903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:38573 (local address 127.0.0.1:37852)
0809 00:46:37.984943 (+ 13040us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:37.984960 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:37.985460 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:37.986122 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:37.986127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:37.986152 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:37.987916 (+ 1764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.987940 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.994680 (+ 6740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.994683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.995980 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:37.995993 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:37.998602 (+ 2609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:37.998608 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:37.998795 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:37.998831 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:46:37.998949 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 00:46:37.999096 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12925,"thread_start_us":12659,"threads_started":1}
I20260809 00:46:38.000574 8558 tablet_service.cc:1467] Processing CreateTablet for tablet 2502b443300e426bb881ebedd04bc45c (DEFAULT_TABLE table=test-table [id=e58517b6e4074b5181d78efe27de020d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:38.001012 8558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2502b443300e426bb881ebedd04bc45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:38.001428 9105 tablet_bootstrap.cc:492] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Bootstrap starting.
I20260809 00:46:38.001859 9103 tablet_bootstrap.cc:492] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: No bootstrap required, opened a new log
I20260809 00:46:38.002044 9103 ts_tablet_manager.cc:1397] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 00:46:38.002846 9103 raft_consensus.cc:348] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.003043 9103 raft_consensus.cc:374] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:38.003134 9103 raft_consensus.cc:729] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bfcac3cc5449249643646b85a1530c, State: Initialized, Role: FOLLOWER
I20260809 00:46:38.003437 9103 consensus_queue.cc:260] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.003793 9105 tablet_bootstrap.cc:654] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:38.008538 9103 ts_tablet_manager.cc:1428] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260809 00:46:38.010735 9115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.009648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:45715)
0809 00:46:38.010293 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.010474 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"threads_started":1}
I20260809 00:46:38.011991 8380 heartbeater.cc:503] Master 127.28.92.188:46319 was elected leader, sending a full tablet report...
I20260809 00:46:38.012259 9105 tablet_bootstrap.cc:492] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: No bootstrap required, opened a new log
I20260809 00:46:38.012629 9105 ts_tablet_manager.cc:1397] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260809 00:46:38.013550 9105 raft_consensus.cc:348] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.013876 9105 raft_consensus.cc:374] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:38.013968 9105 raft_consensus.cc:729] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d7b997559ca472f89c4a20a9c992c46, State: Initialized, Role: FOLLOWER
I20260809 00:46:38.014262 9105 consensus_queue.cc:260] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.015885 9115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.015398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:58117)
0809 00:46:38.015589 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.015701 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 00:46:38.018345 9105 ts_tablet_manager.cc:1428] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260809 00:46:38.018622 8926 heartbeater.cc:503] Master 127.28.92.188:46319 was elected leader, sending a full tablet report...
I20260809 00:46:38.020514 9114 tablet_bootstrap.cc:492] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Bootstrap starting.
I20260809 00:46:38.022418 9118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.015365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:58325)
0809 00:46:38.022052 (+ 6687us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.022210 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6577,"thread_start_us":6475,"threads_started":1}
I20260809 00:46:38.022648 9114 tablet_bootstrap.cc:654] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:38.024130 9118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.023707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:34767)
0809 00:46:38.023899 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.023986 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260809 00:46:38.024995 9114 tablet_bootstrap.cc:492] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: No bootstrap required, opened a new log
I20260809 00:46:38.025134 9114 ts_tablet_manager.cc:1397] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260809 00:46:38.025810 9114 raft_consensus.cc:348] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.026062 9114 raft_consensus.cc:374] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:38.026155 9114 raft_consensus.cc:729] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fd22afd19fc468d819953bcab76ef57, State: Initialized, Role: FOLLOWER
I20260809 00:46:38.026382 9114 consensus_queue.cc:260] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.027139 9114 ts_tablet_manager.cc:1428] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 00:46:38.028414 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.027423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:51027)
0809 00:46:38.027969 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.028145 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":288,"threads_started":1}
I20260809 00:46:38.029568 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.029217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:32817)
0809 00:46:38.029351 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.029424 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 00:46:38.029722 8684 heartbeater.cc:503] Master 127.28.92.188:46319 was elected leader, sending a full tablet report...
W20260809 00:46:38.138839 8687 tablet.cc:2369] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:38.188566 9117 raft_consensus.cc:482] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:38.188822 9117 raft_consensus.cc:504] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.189626 9117 leader_election.cc:288] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115), 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:38.190378 8298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2502b443300e426bb881ebedd04bc45c" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bfcac3cc5449249643646b85a1530c" is_pre_election: true
I20260809 00:46:38.190405 8589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2502b443300e426bb881ebedd04bc45c" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd22afd19fc468d819953bcab76ef57" is_pre_election: true
I20260809 00:46:38.190661 8589 raft_consensus.cc:2454] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 0.
I20260809 00:46:38.190661 8298 raft_consensus.cc:2454] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 0.
I20260809 00:46:38.191200 8736 leader_election.cc:302] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd22afd19fc468d819953bcab76ef57, 9d7b997559ca472f89c4a20a9c992c46; no voters:
I20260809 00:46:38.191529 9117 raft_consensus.cc:2781] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:38.191687 9117 raft_consensus.cc:482] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:38.191782 9117 raft_consensus.cc:3037] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:38.194736 9117 raft_consensus.cc:504] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.195341 9117 leader_election.cc:288] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 election: Requested vote from peers 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115), 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573)
I20260809 00:46:38.196735 8298 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2502b443300e426bb881ebedd04bc45c" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33bfcac3cc5449249643646b85a1530c"
I20260809 00:46:38.196799 8589 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2502b443300e426bb881ebedd04bc45c" candidate_uuid: "9d7b997559ca472f89c4a20a9c992c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fd22afd19fc468d819953bcab76ef57"
I20260809 00:46:38.196952 8298 raft_consensus.cc:3037] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:38.197000 8589 raft_consensus.cc:3037] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:38.199124 8589 raft_consensus.cc:2454] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 1.
I20260809 00:46:38.199141 8298 raft_consensus.cc:2454] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d7b997559ca472f89c4a20a9c992c46 in term 1.
I20260809 00:46:38.199520 8736 leader_election.cc:302] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fd22afd19fc468d819953bcab76ef57, 9d7b997559ca472f89c4a20a9c992c46; no voters:
I20260809 00:46:38.199817 9117 raft_consensus.cc:2781] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:38.200253 9117 raft_consensus.cc:686] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 1 LEADER]: Becoming Leader. State: Replica: 9d7b997559ca472f89c4a20a9c992c46, State: Running, Role: LEADER
I20260809 00:46:38.200620 9117 consensus_queue.cc:237] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } }
I20260809 00:46:38.201574 9118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.201060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:46085)
0809 00:46:38.201249 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.201369 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 00:46:38.203588 8038 catalog_manager.cc:5495] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "9d7b997559ca472f89c4a20a9c992c46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d7b997559ca472f89c4a20a9c992c46" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 } health_report { overall_health: UNKNOWN } } }
I20260809 00:46:38.237092 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.232616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.28.92.131:35485)
0809 00:46:38.232821 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:38.232825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:38.232844 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:46:38.233049 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:38.233053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:38.233127 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:38.233207 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:38.233523 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.234313 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.235588 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.236071 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.236168 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:38.236493 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:38.236590 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:38.236652 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:38.236744 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 00:46:38.236854 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 00:46:38.240195 8589 raft_consensus.cc:1261] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Refusing update from remote peer 9d7b997559ca472f89c4a20a9c992c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:38.240262 8298 raft_consensus.cc:1261] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Refusing update from remote peer 9d7b997559ca472f89c4a20a9c992c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:38.240823 9124 consensus_queue.cc:1035] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fd22afd19fc468d819953bcab76ef57" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:38.241180 9117 consensus_queue.cc:1035] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33bfcac3cc5449249643646b85a1530c" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:38.243772 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.242967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:40913)
0809 00:46:38.243440 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.243594 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352}
I20260809 00:46:38.244371 9115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.243184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:56943)
0809 00:46:38.244063 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.244166 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":735}
I20260809 00:46:38.250092 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.249606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.130:46973)
0809 00:46:38.249853 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.249943 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
I20260809 00:46:38.251509 9118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.251061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:47053)
0809 00:46:38.251255 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.251340 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260809 00:46:38.253137 9115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.252580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.129:57979)
0809 00:46:38.252896 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.252990 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213}
I20260809 00:46:38.254632 9129 mvcc.cc:205] Tried to move back new op lower bound from 7316424287186214912 to 7316424287032139776. Current Snapshot: MvccSnapshot[applied={T|T < 7316424287186214912}]
I20260809 00:46:38.255832 9118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.255245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.28.92.131:43147)
0809 00:46:38.255550 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.255638 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260809 00:46:38.258195 8038 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:38.258509 8038 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:38.266697 8038 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b839134fd4a42dfaa015e20fcd78375: Sending DeleteTablet for 3 replicas of tablet 2502b443300e426bb881ebedd04bc45c
I20260809 00:46:38.267762 8246 tablet_service.cc:1514] Processing DeleteTablet for tablet 2502b443300e426bb881ebedd04bc45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:38 UTC) from {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:48454
I20260809 00:46:38.267802 8245 tablet_service.cc:1514] Processing DeleteTablet for tablet 2502b443300e426bb881ebedd04bc45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:38 UTC) from {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:48454
I20260809 00:46:38.268056 8817 tablet_service.cc:1514] Processing DeleteTablet for tablet 2502b443300e426bb881ebedd04bc45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:38 UTC) from {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:48086
I20260809 00:46:38.268769 9139 tablet_replica.cc:330] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: stopping tablet replica
I20260809 00:46:38.268808 8558 tablet_service.cc:1514] Processing DeleteTablet for tablet 2502b443300e426bb881ebedd04bc45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:38 UTC) from {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:37852
I20260809 00:46:38.268878 8557 tablet_service.cc:1514] Processing DeleteTablet for tablet 2502b443300e426bb881ebedd04bc45c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:38 UTC) from {username='oryx', principal='oryx/127.28.92.188@KRBTEST.COM'} at 127.0.0.1:37852
I20260809 00:46:38.269017 9138 tablet_replica.cc:330] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: stopping tablet replica
I20260809 00:46:38.269178 9138 raft_consensus.cc:2229] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:38.269145 9139 raft_consensus.cc:2229] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:38.269466 9138 raft_consensus.cc:2258] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:38.269593 9139 raft_consensus.cc:2258] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:38.270491 9138 ts_tablet_manager.cc:1905] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:38.270695 9139 ts_tablet_manager.cc:1905] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:38.270817 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 8011
I20260809 00:46:38.277526 9138 ts_tablet_manager.cc:1918] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:38.277519 9139 ts_tablet_manager.cc:1918] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:38.277694 9139 log.cc:1196] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/2502b443300e426bb881ebedd04bc45c
I20260809 00:46:38.277874 9138 log.cc:1196] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/2502b443300e426bb881ebedd04bc45c
I20260809 00:46:38.278172 9139 ts_tablet_manager.cc:1939] T 2502b443300e426bb881ebedd04bc45c P 9d7b997559ca472f89c4a20a9c992c46: Deleting consensus metadata
I20260809 00:46:38.278512 9138 ts_tablet_manager.cc:1939] T 2502b443300e426bb881ebedd04bc45c P 33bfcac3cc5449249643646b85a1530c: Deleting consensus metadata
I20260809 00:46:38.279462 8017 catalog_manager.cc:4841] TS 9d7b997559ca472f89c4a20a9c992c46 (127.28.92.131:35485): tablet 2502b443300e426bb881ebedd04bc45c (table test-table [id=e58517b6e4074b5181d78efe27de020d]) successfully deleted
I20260809 00:46:38.279886 8016 catalog_manager.cc:4841] TS 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115): tablet 2502b443300e426bb881ebedd04bc45c (table test-table [id=e58517b6e4074b5181d78efe27de020d]) successfully deleted
W20260809 00:46:38.280681 8016 catalog_manager.cc:4808] TS 33bfcac3cc5449249643646b85a1530c (127.28.92.129:42115): delete failed for tablet 2502b443300e426bb881ebedd04bc45c because the tablet was not found. No further retry: Not found: Tablet not found: 2502b443300e426bb881ebedd04bc45c
I20260809 00:46:38.282583 9140 tablet_replica.cc:330] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: stopping tablet replica
I20260809 00:46:38.282764 9140 raft_consensus.cc:2229] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:38.283058 9140 raft_consensus.cc:2258] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:38.283964 9140 ts_tablet_manager.cc:1905] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:38.288516 9140 ts_tablet_manager.cc:1918] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:38.288642 9140 log.cc:1196] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/2502b443300e426bb881ebedd04bc45c
I20260809 00:46:38.289005 9140 ts_tablet_manager.cc:1939] T 2502b443300e426bb881ebedd04bc45c P 4fd22afd19fc468d819953bcab76ef57: Deleting consensus metadata
I20260809 00:46:38.290028 8016 catalog_manager.cc:4841] TS 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573): tablet 2502b443300e426bb881ebedd04bc45c (table test-table [id=e58517b6e4074b5181d78efe27de020d]) successfully deleted
W20260809 00:46:38.290321 8016 catalog_manager.cc:4808] TS 4fd22afd19fc468d819953bcab76ef57 (127.28.92.130:38573): delete failed for tablet 2502b443300e426bb881ebedd04bc45c because the tablet was not found. No further retry: Not found: Tablet not found: 2502b443300e426bb881ebedd04bc45c
I20260809 00:46:38.294642 9097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.271936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48456 (local address 127.28.92.129:42115)
0809 00:46:38.272118 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:38.272124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:38.282156 (+ 10032us) server_negotiation.cc:407] Connection header received
0809 00:46:38.282336 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:38.282339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:38.282402 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:38.282484 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:38.284013 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.284714 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.285939 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.286431 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.286539 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:38.289016 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:38.289032 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:38.289049 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:38.289080 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:38.291971 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:38.292676 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:38.292684 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:38.292687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:38.292837 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:38.293188 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:38.293193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:38.293195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:38.293550 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:38.293877 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:38.294124 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 00:46:38.294342 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:46:38.295259 8374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:38.387737 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 8011
I20260809 00:46:38.412740 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 8412
I20260809 00:46:38.424934 9101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.413600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37862 (local address 127.28.92.130:38573)
0809 00:46:38.413828 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:38.413833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:38.413867 (+ 34us) server_negotiation.cc:407] Connection header received
0809 00:46:38.413925 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:38.413929 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:38.413995 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:38.414070 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:38.415268 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.415963 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.417226 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.417730 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.417826 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:38.420097 (+ 2271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:38.420114 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:38.420132 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:38.420164 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:38.422723 (+ 2559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:38.423282 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:38.423289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:38.423291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:38.423402 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:38.423706 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:38.423710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:38.423712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:38.424048 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:38.424289 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:38.424467 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 00:46:38.424629 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 00:46:38.425642 8674 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:38.468161 9099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.467725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50072)
0809 00:46:38.467898 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.468015 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 00:46:38.469519 9099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.469197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50084)
0809 00:46:38.469333 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.469408 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 00:46:38.519392 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 8412
I20260809 00:46:38.541210 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 8703
I20260809 00:46:38.553261 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.541966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48104 (local address 127.28.92.131:35485)
0809 00:46:38.542151 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:38.542155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:38.542177 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:46:38.542333 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:38.542336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:38.542401 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:38.542487 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:38.543758 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.544443 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.545546 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:38.546058 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:38.546148 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:38.548413 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:38.548430 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:38.548447 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:38.548478 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:38.551070 (+ 2592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:38.551643 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:38.551650 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:38.551653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:38.551768 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:38.552033 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:38.552037 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:38.552038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:38.552375 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:38.552594 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:38.552778 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 00:46:38.552942 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 00:46:38.553961 8917 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:38.671716 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 8703
I20260809 00:46:38.697398 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 7488
I20260809 00:46:38.698583 7780 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:38.813423 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 7488
I20260809 00:46:38.838411 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 7656
I20260809 00:46:38.839424 8087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:38.959285 9099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:38.958851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36087 (local address 127.0.0.1:50092)
0809 00:46:38.959039 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:38.959125 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:36087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 00:46:38.959254 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 7656
2026-08-09T00:46:38Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10179 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:39 dist-test-slave-t7g5 krb5kdc[9161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:39 dist-test-slave-t7g5 krb5kdc[9161](info): set up 2 sockets
Aug 09 00:46:39 dist-test-slave-t7g5 krb5kdc[9161](info): commencing operation
krb5kdc: starting...
W20260809 00:46:40.202061 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:40 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:40Z Disabled control of system clock
WARNING: no policy specified for oryx/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab.
Entry for principal oryx/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab.
I20260809 00:46:40.446870 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36729
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab
--principal=oryx/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:40.779551 9192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:40.779850 9192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:40.779996 9192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:40.787118 9192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:40.787225 9192 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 00:46:40.787289 9192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:40.787375 9192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:40.787447 9192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:40.787535 9192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:40.797293 9192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36729
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.190.keytab
--principal=oryx/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:40.798609 9192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:40.799942 9192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:40.811180 9201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:40.811141 9205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:40.811203 9207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:40.812405 9192 server_base.cc:1034] running on GCE node
I20260809 00:46:40.813145 9192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:40.814534 9192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:40.815753 9192 hybrid_clock.cc:648] HybridClock initialized: now 1786236400815658 us; error 59 us; skew 500 ppm
I20260809 00:46:40.816063 9192 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:40 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236400, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:40.819054 9192 init.cc:377] Logged in from keytab as oryx/127.28.92.190@KRBTEST.COM (short username oryx)
I20260809 00:46:40.820513 9192 webserver.cc:460] Webserver started at http://127.28.92.190:35577/ using document root <none> and password file <none>
I20260809 00:46:40.821213 9192 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:40.821316 9192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:40.821625 9192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:40.824707 9192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "07837afddef8425cbed6b0c29f4c9e1a"
format_stamp: "Formatted at 2026-08-09 00:46:40 on dist-test-slave-t7g5"
server_key: "d236711db967f7e198f35f64e78cadaa"
server_key_iv: "81781824168f4bbf0da2e36ef6c7f29b"
server_key_version: "encryptionkey@0"
I20260809 00:46:40.825538 9192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "07837afddef8425cbed6b0c29f4c9e1a"
format_stamp: "Formatted at 2026-08-09 00:46:40 on dist-test-slave-t7g5"
server_key: "d236711db967f7e198f35f64e78cadaa"
server_key_iv: "81781824168f4bbf0da2e36ef6c7f29b"
server_key_version: "encryptionkey@0"
I20260809 00:46:40.830758 9192 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:46:40.834152 9217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:40.835400 9192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 00:46:40.835579 9192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "07837afddef8425cbed6b0c29f4c9e1a"
format_stamp: "Formatted at 2026-08-09 00:46:40 on dist-test-slave-t7g5"
server_key: "d236711db967f7e198f35f64e78cadaa"
server_key_iv: "81781824168f4bbf0da2e36ef6c7f29b"
server_key_version: "encryptionkey@0"
I20260809 00:46:40.835783 9192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:40.853425 9192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:40.858071 9192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:40.858349 9192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:40.879020 9192 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:36729
I20260809 00:46:40.879040 9334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:36729 every 8 connection(s)
I20260809 00:46:40.880362 9192 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:40.884127 9336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:40.889050 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 9192
I20260809 00:46:40.889273 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:40.890151 29042 external_mini_cluster.cc:1428] Setting key f81c5b37934dddcbb2d9754ecda68780
I20260809 00:46:40.895619 9336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Bootstrap starting.
I20260809 00:46:40.899420 9336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:40.900698 9336 log.cc:824] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:40.903488 9336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: No bootstrap required, opened a new log
Aug 09 00:46:40 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:40.911298 9336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07837afddef8425cbed6b0c29f4c9e1a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36729 } }
I20260809 00:46:40.911722 9336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:40.911826 9336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07837afddef8425cbed6b0c29f4c9e1a, State: Initialized, Role: FOLLOWER
I20260809 00:46:40.912442 9336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07837afddef8425cbed6b0c29f4c9e1a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36729 } }
I20260809 00:46:40.912631 9342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:40.892285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55106 (local address 127.28.92.190:36729)
0809 00:46:40.893119 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:40.893133 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:40.893176 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:46:40.894935 (+ 1759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:40.894967 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:40.895358 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:40.895709 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:40.897448 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:40.898793 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:40.900533 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:40.901322 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:40.901520 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:40.905467 (+ 3947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:40.905475 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:40.905494 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:40.905538 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:40.908554 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:40.909205 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:40.909211 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:40.909218 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:40.909408 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:40.909841 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:40.909845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:40.909846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:40.910398 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:40.910675 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:40.911142 (+ 467us) server_negotiation.cc:299] Negotiation successful
0809 00:46:40.911549 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":365,"threads_started":1}
I20260809 00:46:40.912691 9336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:40.912815 9336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:40.913007 9336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:40.916035 9336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07837afddef8425cbed6b0c29f4c9e1a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36729 } }
I20260809 00:46:40.916549 9336 leader_election.cc:302] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07837afddef8425cbed6b0c29f4c9e1a; no voters:
I20260809 00:46:40.917093 9336 leader_election.cc:288] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:40.917218 9347 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:40.917932 9347 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [term 1 LEADER]: Becoming Leader. State: Replica: 07837afddef8425cbed6b0c29f4c9e1a, State: Running, Role: LEADER
I20260809 00:46:40.918468 9347 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07837afddef8425cbed6b0c29f4c9e1a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36729 } }
I20260809 00:46:40.919099 9336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:40.921159 9349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07837afddef8425cbed6b0c29f4c9e1a. Latest consensus state: current_term: 1 leader_uuid: "07837afddef8425cbed6b0c29f4c9e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07837afddef8425cbed6b0c29f4c9e1a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36729 } } }
I20260809 00:46:40.921231 9348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07837afddef8425cbed6b0c29f4c9e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07837afddef8425cbed6b0c29f4c9e1a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36729 } } }
I20260809 00:46:40.921600 9349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:40.921710 9348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:40.922516 9352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:40.929787 9352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:40.940521 9352 catalog_manager.cc:1347] Generated new cluster ID: c8bebb3979224a7890bf97c09bd23f73
I20260809 00:46:40.940646 9352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:40.966785 9352 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:40.968258 9352 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:40.976365 9352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Generated new TSK 0
I20260809 00:46:40.977134 9352 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab.
Entry for principal oryx/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab.
I20260809 00:46:41.049230 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36729
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:41.373241 9375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:41.373548 9375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:41.373729 9375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:41.381268 9375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:41.381376 9375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:41.381511 9375 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:46:41.381623 9375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:41.390949 9375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:41.392163 9375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:41.393500 9375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:41.405915 9384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:41.405962 9392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:41.405978 9385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:41.407043 9375 server_base.cc:1034] running on GCE node
I20260809 00:46:41.407646 9375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:41.408502 9375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:41.409766 9375 hybrid_clock.cc:648] HybridClock initialized: now 1786236401409706 us; error 39 us; skew 500 ppm
I20260809 00:46:41.410054 9375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:41 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236401, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:41.413128 9375 init.cc:377] Logged in from keytab as oryx/127.28.92.129@KRBTEST.COM (short username oryx)
I20260809 00:46:41.414584 9375 webserver.cc:460] Webserver started at http://127.28.92.129:45805/ using document root <none> and password file <none>
I20260809 00:46:41.415256 9375 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:41.415355 9375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:41.415678 9375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:41.418642 9375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "6d68b9f7ea714f4c917ddbcf7181e913"
format_stamp: "Formatted at 2026-08-09 00:46:41 on dist-test-slave-t7g5"
server_key: "8b8c5903338bc0f7a3ab1123370ce6a3"
server_key_iv: "d3e8b97087206545be850bf3dab24256"
server_key_version: "encryptionkey@0"
I20260809 00:46:41.419464 9375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "6d68b9f7ea714f4c917ddbcf7181e913"
format_stamp: "Formatted at 2026-08-09 00:46:41 on dist-test-slave-t7g5"
server_key: "8b8c5903338bc0f7a3ab1123370ce6a3"
server_key_iv: "d3e8b97087206545be850bf3dab24256"
server_key_version: "encryptionkey@0"
I20260809 00:46:41.424523 9375 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:46:41.427870 9406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:41.429114 9375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 00:46:41.429260 9375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "6d68b9f7ea714f4c917ddbcf7181e913"
format_stamp: "Formatted at 2026-08-09 00:46:41 on dist-test-slave-t7g5"
server_key: "8b8c5903338bc0f7a3ab1123370ce6a3"
server_key_iv: "d3e8b97087206545be850bf3dab24256"
server_key_version: "encryptionkey@0"
I20260809 00:46:41.429457 9375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:41.445411 9375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:41.449013 9375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:41.449250 9375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:41.451833 9375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:41.451939 9375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:41.452088 9375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:41.452160 9375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:46:41 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236401, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:41.473927 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:41.452149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:45585 (local address 127.28.92.190:36729)
0809 00:46:41.452656 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:41.452662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:41.453740 (+ 1078us) server_negotiation.cc:407] Connection header received
0809 00:46:41.455704 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:41.455710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:41.455794 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:41.455891 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:41.457966 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.458931 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.461345 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.461825 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.461951 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:41.466874 (+ 4923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:41.466880 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:41.466885 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:41.466930 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:41.469967 (+ 3037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:41.470937 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:41.470942 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:41.470946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:41.471110 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:41.471695 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:41.471700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:41.471703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:41.472040 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:41.472186 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:41.473218 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0809 00:46:41.473492 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":241,"threads_started":1}
I20260809 00:46:41.474772 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:41.452687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.28.92.129:45585)
0809 00:46:41.453557 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:41.453601 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:41.455413 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:41.456134 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:41.456144 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:41.456819 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:41.457761 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:41.457792 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.459127 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.459133 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:41.461197 (+ 2064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:41.461213 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.462072 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.462080 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:41.462391 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:41.463182 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:41.463217 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:41.466588 (+ 3371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:41.470123 (+ 3535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:41.470130 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:41.470142 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:41.470763 (+ 621us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:41.471229 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:41.471234 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:41.471241 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:41.471539 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:41.472263 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:41.472269 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:41.472754 (+ 485us) client_negotiation.cc:769] Sending connection context
0809 00:46:41.473082 (+ 328us) client_negotiation.cc:240] Negotiation successful
0809 00:46:41.473521 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":339,"threads_started":1}
I20260809 00:46:41.493894 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:41.480229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:46955 (local address 127.28.92.190:36729)
0809 00:46:41.480376 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:41.480380 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:41.480977 (+ 597us) server_negotiation.cc:407] Connection header received
0809 00:46:41.481101 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:41.481107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:41.481192 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:41.481298 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:41.482453 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.483559 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.485166 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.485881 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.486018 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:41.488086 (+ 2068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:41.488092 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:41.488095 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:41.488124 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:41.491070 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:41.491888 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:41.491892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:41.491894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:41.492014 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:41.492390 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:41.492395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:41.492398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:41.492768 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:41.492899 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:41.493306 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 00:46:41.493538 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 00:46:41.494059 9552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:41.480330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.28.92.129:46955)
0809 00:46:41.480886 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:41.480905 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:41.481011 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:41.481305 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:41.481308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:41.481812 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:41.482225 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:41.482237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.483691 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.483696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:41.485023 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:41.485037 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.486048 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.486053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:41.486172 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:41.486783 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:41.486809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:41.487908 (+ 1099us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:41.491193 (+ 3285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:41.491202 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:41.491206 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:41.491774 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:41.492126 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:41.492131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:41.492135 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:41.492277 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:41.492881 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:41.492886 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:41.493065 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 00:46:41.493183 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 00:46:41.493492 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":304,"threads_started":1}
I20260809 00:46:41.505437 9375 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:41047
I20260809 00:46:41.505483 9624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:41047 every 8 connection(s)
I20260809 00:46:41.506652 9375 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:41.508653 9625 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36729
I20260809 00:46:41.508859 9625 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:41.509480 9625 heartbeater.cc:511] Master 127.28.92.190:36729 requested a full tablet report, sending...
I20260809 00:46:41.511377 9256 ts_manager.cc:194] Registered new tserver with Master: 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047)
I20260809 00:46:41.512786 9256 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:45585
I20260809 00:46:41.515339 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 9375
I20260809 00:46:41.515548 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:41.516151 29042 external_mini_cluster.cc:1428] Setting key a1a6732919a1eadd89813b091d26cc89
WARNING: no policy specified for oryx/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab.
Entry for principal oryx/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab.
I20260809 00:46:41.566978 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36729
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:41.894415 9632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:41.894706 9632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:41.894833 9632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:41.902586 9632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:41.902714 9632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:41.902832 9632 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:46:41.902927 9632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:41.913108 9632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:41.914496 9632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:41.916004 9632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:41.929585 9650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:41.930084 9653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:41.930297 9644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:41.930771 9632 server_base.cc:1034] running on GCE node
I20260809 00:46:41.931411 9632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:41.932379 9632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:41.933591 9632 hybrid_clock.cc:648] HybridClock initialized: now 1786236401933521 us; error 40 us; skew 500 ppm
I20260809 00:46:41.933960 9632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:41 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236401, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:41.937027 9632 init.cc:377] Logged in from keytab as oryx/127.28.92.130@KRBTEST.COM (short username oryx)
I20260809 00:46:41.938544 9632 webserver.cc:460] Webserver started at http://127.28.92.130:37055/ using document root <none> and password file <none>
I20260809 00:46:41.939252 9632 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:41.939381 9632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:41.939713 9632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:41.942726 9632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "85f7d0fe3e0242e4835fd0c92e23eddb"
format_stamp: "Formatted at 2026-08-09 00:46:41 on dist-test-slave-t7g5"
server_key: "41bd08e6edd1a4aaeccb3ffbe311e56c"
server_key_iv: "766e321a36fca81cbd9e82f07e443d53"
server_key_version: "encryptionkey@0"
I20260809 00:46:41.943535 9632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "85f7d0fe3e0242e4835fd0c92e23eddb"
format_stamp: "Formatted at 2026-08-09 00:46:41 on dist-test-slave-t7g5"
server_key: "41bd08e6edd1a4aaeccb3ffbe311e56c"
server_key_iv: "766e321a36fca81cbd9e82f07e443d53"
server_key_version: "encryptionkey@0"
I20260809 00:46:41.948736 9632 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:46:41.952184 9665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:41.953478 9632 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:46:41.953625 9632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "85f7d0fe3e0242e4835fd0c92e23eddb"
format_stamp: "Formatted at 2026-08-09 00:46:41 on dist-test-slave-t7g5"
server_key: "41bd08e6edd1a4aaeccb3ffbe311e56c"
server_key_iv: "766e321a36fca81cbd9e82f07e443d53"
server_key_version: "encryptionkey@0"
I20260809 00:46:41.953890 9632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:41.967877 9632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:41.971686 9632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:41.971935 9632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:41.974593 9632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:41.974694 9632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:41.974867 9632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:41.974984 9632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:46:41 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236401, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:41.997170 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:41.975008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:36503 (local address 127.28.92.190:36729)
0809 00:46:41.975203 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:41.975210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:41.976641 (+ 1431us) server_negotiation.cc:407] Connection header received
0809 00:46:41.978895 (+ 2254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:41.978901 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:41.978999 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:41.979086 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:41.981148 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.982345 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.984751 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.985443 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.985602 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:41.990562 (+ 4960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:41.990568 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:41.990571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:41.990606 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:41.993699 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:41.994750 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:41.994755 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:41.994757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:41.994881 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:41.995380 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:41.995383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:41.995385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:41.995686 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:41.995805 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:41.996735 (+ 930us) server_negotiation.cc:299] Negotiation successful
0809 00:46:41.996907 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:46:41.999178 9686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:41.975582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.28.92.130:36503)
0809 00:46:41.976486 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:41.976540 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:41.978606 (+ 2066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:41.979373 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:41.979385 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:41.980142 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:41.980940 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:41.980967 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.982535 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.982541 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:41.984586 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:41.984599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:41.985747 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:41.985755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:41.985984 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:41.986750 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:41.986791 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:41.990288 (+ 3497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:41.993857 (+ 3569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:41.993867 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:41.993891 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:41.994623 (+ 732us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:41.994980 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:41.994985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:41.994990 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:41.995286 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:41.995807 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:41.995816 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:41.996321 (+ 505us) client_negotiation.cc:769] Sending connection context
0809 00:46:41.996685 (+ 364us) client_negotiation.cc:240] Negotiation successful
0809 00:46:41.997291 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":346,"threads_started":1}
I20260809 00:46:42.020330 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:42.004908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:60241 (local address 127.28.92.190:36729)
0809 00:46:42.005111 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:42.005117 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:42.005885 (+ 768us) server_negotiation.cc:407] Connection header received
0809 00:46:42.006103 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:42.006109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:42.006204 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:42.006318 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:42.007244 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.008457 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.010470 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.010915 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.011039 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:42.013635 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:42.013640 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:42.013644 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:42.013715 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:42.016825 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:42.017700 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:42.017706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:42.017711 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:42.017898 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:42.018464 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:42.018471 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:42.018475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:42.019026 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:42.019189 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:42.019839 (+ 650us) server_negotiation.cc:299] Negotiation successful
0809 00:46:42.020023 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 00:46:42.020707 9809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:42.004989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.28.92.130:60241)
0809 00:46:42.005754 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:42.005777 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:42.005977 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:42.006334 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:42.006337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:42.006793 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:42.007107 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:42.007117 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.008607 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.008613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:42.010322 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:42.010338 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.011109 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.011116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:42.011291 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:42.012055 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:42.012083 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:42.013441 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:42.016964 (+ 3523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:42.016970 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:42.016974 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:42.017540 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:42.018083 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:42.018088 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:42.018095 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:42.018287 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:42.019288 (+ 1001us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:42.019293 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:42.019554 (+ 261us) client_negotiation.cc:769] Sending connection context
0809 00:46:42.019758 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 00:46:42.020146 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":356,"threads_started":1}
I20260809 00:46:42.022928 9632 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:34513
I20260809 00:46:42.022954 9891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:34513 every 8 connection(s)
I20260809 00:46:42.024560 9632 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:42.026700 9893 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36729
I20260809 00:46:42.026892 9893 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:42.027511 9893 heartbeater.cc:511] Master 127.28.92.190:36729 requested a full tablet report, sending...
I20260809 00:46:42.028836 9256 ts_manager.cc:194] Registered new tserver with Master: 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513)
I20260809 00:46:42.029422 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 9632
I20260809 00:46:42.029583 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:42.029707 9256 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:36503
I20260809 00:46:42.030082 29042 external_mini_cluster.cc:1428] Setting key 6b9722ccc7fb8e80c6e115d1c93bcf46
WARNING: no policy specified for oryx/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab.
Entry for principal oryx/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab.
I20260809 00:46:42.082343 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:36729
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:42.409358 9903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:42.409684 9903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:42.409825 9903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:42.417045 9903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:42.417169 9903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:42.417289 9903 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 00:46:42.417402 9903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:42.427477 9903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.28.92.190:36729
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:42.428757 9903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:42.430094 9903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:42.443262 9917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:42.443305 9924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:42.443295 9920 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:42.443691 9903 server_base.cc:1034] running on GCE node
I20260809 00:46:42.444550 9903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:42.445528 9903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:42.446756 9903 hybrid_clock.cc:648] HybridClock initialized: now 1786236402446653 us; error 102 us; skew 500 ppm
I20260809 00:46:42.447052 9903 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:42 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236402, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:42.450143 9903 init.cc:377] Logged in from keytab as oryx/127.28.92.131@KRBTEST.COM (short username oryx)
I20260809 00:46:42.451515 9903 webserver.cc:460] Webserver started at http://127.28.92.131:43175/ using document root <none> and password file <none>
I20260809 00:46:42.452199 9903 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:42.452296 9903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:42.452610 9903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:42.455632 9903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "8491672baf9e4abfbeffa76ec771d0c8"
format_stamp: "Formatted at 2026-08-09 00:46:42 on dist-test-slave-t7g5"
server_key: "70002d70c303b70ea266b470f57b5800"
server_key_iv: "cc0a2fa7578c60883b26ece5b9f8d325"
server_key_version: "encryptionkey@0"
I20260809 00:46:42.456434 9903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "8491672baf9e4abfbeffa76ec771d0c8"
format_stamp: "Formatted at 2026-08-09 00:46:42 on dist-test-slave-t7g5"
server_key: "70002d70c303b70ea266b470f57b5800"
server_key_iv: "cc0a2fa7578c60883b26ece5b9f8d325"
server_key_version: "encryptionkey@0"
I20260809 00:46:42.461773 9903 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:46:42.465204 9932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:42.466536 9903 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:42.466688 9903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "8491672baf9e4abfbeffa76ec771d0c8"
format_stamp: "Formatted at 2026-08-09 00:46:42 on dist-test-slave-t7g5"
server_key: "70002d70c303b70ea266b470f57b5800"
server_key_iv: "cc0a2fa7578c60883b26ece5b9f8d325"
server_key_version: "encryptionkey@0"
I20260809 00:46:42.466893 9903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:42.488668 9903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:42.492489 9903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:42.492743 9903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:42.495579 9903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:42.495683 9903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:42.495827 9903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:42.495901 9903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:46:42 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236402, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:42.515399 9625 heartbeater.cc:503] Master 127.28.92.190:36729 was elected leader, sending a full tablet report...
I20260809 00:46:42.519608 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:42.495944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:39543 (local address 127.28.92.190:36729)
0809 00:46:42.496126 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:42.496132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:42.497557 (+ 1425us) server_negotiation.cc:407] Connection header received
0809 00:46:42.499691 (+ 2134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:42.499698 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:42.499802 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:42.499924 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:42.502407 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.503372 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.506379 (+ 3007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.507043 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.507171 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:42.512720 (+ 5549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:42.512727 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:42.512733 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:42.512775 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:42.516254 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:42.516963 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:42.516969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:42.516973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:42.517128 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:42.517723 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:42.517727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:42.517729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:42.518010 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:42.518170 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:42.519009 (+ 839us) server_negotiation.cc:299] Negotiation successful
0809 00:46:42.519246 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:46:42.520650 9953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:42.496593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.28.92.131:39543)
0809 00:46:42.497383 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:42.497420 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:42.499282 (+ 1862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:42.500331 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:42.500342 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:42.501217 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:42.502220 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:42.502246 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.503554 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.503561 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:42.506163 (+ 2602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:42.506182 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.507535 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.507544 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:42.507878 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:42.508725 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:42.508766 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:42.512426 (+ 3660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:42.516392 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:42.516402 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:42.516416 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:42.516833 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:42.517247 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:42.517253 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:42.517257 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:42.517559 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:42.518245 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:42.518251 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:42.518601 (+ 350us) client_negotiation.cc:769] Sending connection context
0809 00:46:42.518863 (+ 262us) client_negotiation.cc:240] Negotiation successful
0809 00:46:42.519416 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":338,"threads_started":1}
I20260809 00:46:42.540729 10063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:42.526231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.28.92.131:47625)
0809 00:46:42.526828 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:42.526844 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:42.526994 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:42.527356 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:42.527361 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:42.528166 (+ 805us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:42.528703 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:42.528718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.529996 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.530001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:42.531577 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:42.531593 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.532590 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.532596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:42.532721 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:42.533327 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:42.533345 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:42.534454 (+ 1109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:42.538005 (+ 3551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:42.538011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:42.538015 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:42.538411 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:42.538867 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:42.538871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:42.538874 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:42.539050 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:42.539663 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:42.539668 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:42.539879 (+ 211us) client_negotiation.cc:769] Sending connection context
0809 00:46:42.540024 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 00:46:42.540275 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":343,"threads_started":1}
I20260809 00:46:42.540786 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:42.526117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:47625 (local address 127.28.92.190:36729)
0809 00:46:42.526258 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:42.526262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:42.526929 (+ 667us) server_negotiation.cc:407] Connection header received
0809 00:46:42.527115 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:42.527121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:42.527194 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:42.527292 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:42.528946 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.529849 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.531716 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.532198 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.532318 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:42.534697 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:42.534704 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:42.534709 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:42.534751 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:42.537868 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:42.538564 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:42.538571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:42.538576 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:42.538758 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:42.539157 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:42.539162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:42.539166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:42.539545 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:42.539716 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:42.540147 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 00:46:42.540406 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 00:46:42.550196 9903 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:38025
I20260809 00:46:42.550240 10150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:38025 every 8 connection(s)
I20260809 00:46:42.551457 9903 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:42.553431 10151 heartbeater.cc:347] Connected to a master server at 127.28.92.190:36729
I20260809 00:46:42.553685 10151 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:42.554318 10151 heartbeater.cc:511] Master 127.28.92.190:36729 requested a full tablet report, sending...
I20260809 00:46:42.555658 9256 ts_manager.cc:194] Registered new tserver with Master: 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:42.555687 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 9903
I20260809 00:46:42.555826 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:42.556252 29042 external_mini_cluster.cc:1428] Setting key 5a2a075ae9299d24884c9e5adf51722a
I20260809 00:46:42.556528 9256 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:39543
I20260809 00:46:42.559259 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 00:46:42 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236402, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 00:46:42 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:42 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:43.032569 9893 heartbeater.cc:503] Master 127.28.92.190:36729 was elected leader, sending a full tablet report...
I20260809 00:46:43.559512 10151 heartbeater.cc:503] Master 127.28.92.190:36729 was elected leader, sending a full tablet report...
W20260809 00:46:43.655186 10162 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.047s user 0.002s sys 0.016s
W20260809 00:46:43.656582 9426 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:42.602917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.28.92.190:36729)
0809 00:46:42.603169 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:42.603173 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:42.603268 (+ 95us) server_negotiation.cc:407] Connection header received
0809 00:46:42.603428 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:42.603432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:42.603511 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:42.603597 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:42.604806 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.605533 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.606757 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:42.607179 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:42.607279 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.656223 (+1048944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55114: BlockingRecv error: recv got EOF from 127.0.0.1:55114 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 09 00:46:43 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236402, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:43.676548 9426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.660095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55126 (local address 127.28.92.190:36729)
0809 00:46:43.660315 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:43.660322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:43.660549 (+ 227us) server_negotiation.cc:407] Connection header received
0809 00:46:43.660718 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:43.660723 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:43.660845 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:43.660980 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:43.662405 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.663584 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.664900 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.665587 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.665774 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.670399 (+ 4625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:43.670408 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:43.670414 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:43.670475 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:43.673549 (+ 3074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:43.674375 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:43.674379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:43.674381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:43.674540 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:43.674979 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:43.674983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:43.674985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:43.675311 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:43.675625 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:43.675928 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 00:46:43.676225 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 00:46:43.681083 9256 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:43.688273 9256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:43.724073 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.702566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48064 (local address 127.28.92.131:38025)
0809 00:46:43.714584 (+ 12018us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:43.714594 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:43.714633 (+ 39us) server_negotiation.cc:407] Connection header received
0809 00:46:43.715170 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:43.715177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:43.715454 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:43.715691 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:43.717016 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.718245 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.721074 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.722608 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.722742 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.722980 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:43.723451 (+ 471us) server_negotiation.cc:299] Negotiation successful
0809 00:46:43.723667 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11840,"thread_start_us":11680,"threads_started":1}
I20260809 00:46:43.724359 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.702026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60468 (local address 127.28.92.129:41047)
0809 00:46:43.714913 (+ 12887us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:43.714923 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:43.714956 (+ 33us) server_negotiation.cc:407] Connection header received
0809 00:46:43.715072 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:43.715081 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:43.715382 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:43.715620 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:43.716889 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.718540 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.721494 (+ 2954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.722983 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.723116 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.723384 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:43.723735 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 00:46:43.723905 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12704,"thread_start_us":12771,"threads_started":1}
I20260809 00:46:43.724529 10188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.701557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41047 (local address 127.0.0.1:60468)
0809 00:46:43.712211 (+ 10654us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:43.712273 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:43.712515 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:43.715655 (+ 3140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:43.715663 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:43.715696 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:43.716346 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.716361 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.718710 (+ 2349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.718715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.721281 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.721295 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.723300 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.723310 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.723521 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.723597 (+ 76us) client_negotiation.cc:769] Sending connection context
0809 00:46:43.723677 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:46:43.723906 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10357,"mutex_wait_us":101,"thread_start_us":12625,"threads_started":1}
I20260809 00:46:43.724931 10189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.704062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54326 (local address 127.28.92.130:34513)
0809 00:46:43.713167 (+ 9105us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:43.713177 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:43.715284 (+ 2107us) server_negotiation.cc:407] Connection header received
0809 00:46:43.715463 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:43.715470 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:43.715705 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:43.715893 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:43.717131 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.718662 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.721104 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.722621 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.722769 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.723002 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:43.723840 (+ 838us) server_negotiation.cc:299] Negotiation successful
0809 00:46:43.724088 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8921,"thread_start_us":9721,"threads_started":1}
I20260809 00:46:43.724957 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.701822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:38025 (local address 127.0.0.1:48064)
0809 00:46:43.714511 (+ 12689us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:43.714534 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:43.714688 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:43.715940 (+ 1252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:43.715945 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:43.715985 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:43.716806 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.716819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.718376 (+ 1557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.718382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.720887 (+ 2505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.720907 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.722826 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.722834 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.723045 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.723119 (+ 74us) client_negotiation.cc:769] Sending connection context
0809 00:46:43.723275 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 00:46:43.724451 (+ 1176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12539,"mutex_wait_us":3,"spinlock_wait_cycles":1792,"thread_start_us":13003,"threads_started":1}
I20260809 00:46:43.724977 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.703363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34513 (local address 127.0.0.1:54326)
0809 00:46:43.715137 (+ 11774us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:43.715157 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:43.715309 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:43.715948 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:43.715952 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:43.716000 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:43.716859 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.716873 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.718874 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.718881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.720872 (+ 1991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.720890 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.723255 (+ 2365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.723269 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.723521 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.723610 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 00:46:43.723704 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 00:46:43.724150 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11654,"mutex_wait_us":428,"spinlock_wait_cycles":2304,"thread_start_us":8340,"threads_started":1}
I20260809 00:46:43.729427 9512 tablet_service.cc:1467] Processing CreateTablet for tablet 3af23c8dc2484730ad92a2db9ffa5a9c (DEFAULT_TABLE table=test-table [id=5d0f82e5045a41d28d882320b09c0eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:43.729426 9756 tablet_service.cc:1467] Processing CreateTablet for tablet 3af23c8dc2484730ad92a2db9ffa5a9c (DEFAULT_TABLE table=test-table [id=5d0f82e5045a41d28d882320b09c0eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:43.731132 9756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3af23c8dc2484730ad92a2db9ffa5a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:43.731904 9512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3af23c8dc2484730ad92a2db9ffa5a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:43.733314 10029 tablet_service.cc:1467] Processing CreateTablet for tablet 3af23c8dc2484730ad92a2db9ffa5a9c (DEFAULT_TABLE table=test-table [id=5d0f82e5045a41d28d882320b09c0eb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:43.734799 10029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3af23c8dc2484730ad92a2db9ffa5a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:43.743736 10192 tablet_bootstrap.cc:492] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Bootstrap starting.
I20260809 00:46:43.746312 10193 tablet_bootstrap.cc:492] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Bootstrap starting.
I20260809 00:46:43.747627 10192 tablet_bootstrap.cc:654] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:43.749075 10192 log.cc:824] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:43.750375 10193 tablet_bootstrap.cc:654] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:43.752063 10193 log.cc:824] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:43.753019 10195 tablet_bootstrap.cc:492] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Bootstrap starting.
I20260809 00:46:43.756320 10195 tablet_bootstrap.cc:654] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:43.757611 10195 log.cc:824] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:43.758958 10192 tablet_bootstrap.cc:492] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: No bootstrap required, opened a new log
I20260809 00:46:43.758967 10193 tablet_bootstrap.cc:492] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: No bootstrap required, opened a new log
I20260809 00:46:43.759263 10193 ts_tablet_manager.cc:1397] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260809 00:46:43.759263 10192 ts_tablet_manager.cc:1397] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.004s
I20260809 00:46:43.768080 10195 tablet_bootstrap.cc:492] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: No bootstrap required, opened a new log
I20260809 00:46:43.768379 10195 ts_tablet_manager.cc:1397] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.007s
I20260809 00:46:43.769939 10192 raft_consensus.cc:348] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.769948 10193 raft_consensus.cc:348] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.770424 10193 raft_consensus.cc:374] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:43.770493 10192 raft_consensus.cc:374] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:43.770582 10193 raft_consensus.cc:729] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Initialized, Role: FOLLOWER
I20260809 00:46:43.770617 10192 raft_consensus.cc:729] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Initialized, Role: FOLLOWER
I20260809 00:46:43.771340 10193 consensus_queue.cc:260] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.771342 10192 consensus_queue.cc:260] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.773285 10193 ts_tablet_manager.cc:1428] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260809 00:46:43.776564 10192 ts_tablet_manager.cc:1428] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
W20260809 00:46:43.777318 9895 tablet.cc:2369] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:43.777918 10195 raft_consensus.cc:348] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.778488 10195 raft_consensus.cc:374] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:43.778645 10195 raft_consensus.cc:729] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8491672baf9e4abfbeffa76ec771d0c8, State: Initialized, Role: FOLLOWER
I20260809 00:46:43.779353 10195 consensus_queue.cc:260] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.780848 10195 ts_tablet_manager.cc:1428] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
W20260809 00:46:43.803838 10153 tablet.cc:2369] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:43.922880 10199 raft_consensus.cc:482] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:43.923218 10199 raft_consensus.cc:504] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.925015 10199 leader_election.cc:288] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:43.931706 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.925551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:45003 (local address 127.28.92.131:38025)
0809 00:46:43.925787 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:43.925794 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:43.926472 (+ 678us) server_negotiation.cc:407] Connection header received
0809 00:46:43.926670 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:43.926676 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:43.926739 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:43.926815 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:43.927360 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.928253 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.930068 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.930828 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.930980 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.931061 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:43.931326 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 00:46:43.931475 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:46:43.931738 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.925622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:41217 (local address 127.28.92.129:41047)
0809 00:46:43.925846 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:43.925851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:43.926841 (+ 990us) server_negotiation.cc:407] Connection header received
0809 00:46:43.927013 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:43.927017 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:43.927086 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:43.927160 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:43.927737 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.928446 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.930137 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.930900 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.931060 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.931134 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:43.931390 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 00:46:43.931514 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 00:46:43.931844 10204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.926054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41047 (local address 127.28.92.130:41217)
0809 00:46:43.926735 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:43.926750 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:43.926883 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:43.927203 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:43.927208 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:43.927231 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:43.927560 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.927570 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.928578 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.928582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.929997 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.930010 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.931117 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.931123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.931249 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.931271 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 00:46:43.931349 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 00:46:43.931478 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":390,"threads_started":1}
I20260809 00:46:43.931872 10203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:43.925559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:38025 (local address 127.28.92.130:45003)
0809 00:46:43.926341 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:43.926360 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:43.926523 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:43.926849 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:43.926854 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:43.926907 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:43.927215 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.927225 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.928375 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.928379 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.929908 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:43.929925 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:43.931037 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:43.931043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:43.931180 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:43.931204 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:46:43.931285 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 00:46:43.931415 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":1,"spinlock_wait_cycles":4992,"thread_start_us":426,"threads_started":1}
I20260809 00:46:43.933140 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af23c8dc2484730ad92a2db9ffa5a9c" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8" is_pre_election: true
I20260809 00:46:43.933139 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af23c8dc2484730ad92a2db9ffa5a9c" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" is_pre_election: true
I20260809 00:46:43.933755 9557 raft_consensus.cc:2454] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 0.
I20260809 00:46:43.933755 10072 raft_consensus.cc:2454] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 0.
I20260809 00:46:43.934477 9672 leader_election.cc:302] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:43.934886 10199 raft_consensus.cc:2781] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:43.935030 10199 raft_consensus.cc:482] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:43.935129 10199 raft_consensus.cc:3037] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:43.937237 10199 raft_consensus.cc:504] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.937850 10199 leader_election.cc:288] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 election: Requested vote from peers 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:43.938256 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af23c8dc2484730ad92a2db9ffa5a9c" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d68b9f7ea714f4c917ddbcf7181e913"
I20260809 00:46:43.938269 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3af23c8dc2484730ad92a2db9ffa5a9c" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8"
I20260809 00:46:43.938438 10072 raft_consensus.cc:3037] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:43.938432 9557 raft_consensus.cc:3037] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:43.940635 10072 raft_consensus.cc:2454] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 1.
I20260809 00:46:43.940718 9557 raft_consensus.cc:2454] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 1.
I20260809 00:46:43.941026 9675 leader_election.cc:302] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8491672baf9e4abfbeffa76ec771d0c8, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:43.941327 10199 raft_consensus.cc:2781] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:43.941759 10199 raft_consensus.cc:686] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 LEADER]: Becoming Leader. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Running, Role: LEADER
I20260809 00:46:43.942258 10199 consensus_queue.cc:237] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } }
I20260809 00:46:43.946635 9255 catalog_manager.cc:5495] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130). New cstate: current_term: 1 leader_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } health_report { overall_health: HEALTHY } } }
W20260809 00:46:44.010007 9627 tablet.cc:2369] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:46:44.017545 10189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.012286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.28.92.130:34513)
0809 00:46:44.012509 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.012515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.012587 (+ 72us) server_negotiation.cc:407] Connection header received
0809 00:46:44.012853 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.012857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.012952 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.013086 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:44.013447 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.014172 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.015426 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.015847 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.015962 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.016422 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.016960 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.017098 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.017200 (+ 102us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.017286 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:46:44.026330 10072 raft_consensus.cc:1261] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Refusing update from remote peer 85f7d0fe3e0242e4835fd0c92e23eddb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:44.026320 9557 raft_consensus.cc:1261] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Refusing update from remote peer 85f7d0fe3e0242e4835fd0c92e23eddb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:44.027307 10199 consensus_queue.cc:1035] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:44.027674 10205 consensus_queue.cc:1035] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:44.039592 10210 mvcc.cc:205] Tried to move back new op lower bound from 7316424310880755712 to 7316424310551502848. Current Snapshot: MvccSnapshot[applied={T|T < 7316424310880755712}]
I20260809 00:46:44.053936 9256 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:44.054239 9256 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:44.058135 9256 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Sending DeleteTablet for 3 replicas of tablet 3af23c8dc2484730ad92a2db9ffa5a9c
I20260809 00:46:44.059222 9512 tablet_service.cc:1514] Processing DeleteTablet for tablet 3af23c8dc2484730ad92a2db9ffa5a9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:44 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60468
I20260809 00:46:44.059267 10029 tablet_service.cc:1514] Processing DeleteTablet for tablet 3af23c8dc2484730ad92a2db9ffa5a9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:44 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:48064
I20260809 00:46:44.059638 9756 tablet_service.cc:1514] Processing DeleteTablet for tablet 3af23c8dc2484730ad92a2db9ffa5a9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:44 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:54326
I20260809 00:46:44.061797 9256 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55126:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:44.062975 9256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:44.071558 10028 tablet_service.cc:1467] Processing CreateTablet for tablet aae5aeadd6ab416b8eb49b1916311599 (DEFAULT_TABLE table=test-table [id=c48b4a26a7c04c0cb26dfefad903a944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:44.072228 10028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aae5aeadd6ab416b8eb49b1916311599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:44.073491 10227 tablet_replica.cc:330] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: stopping tablet replica
I20260809 00:46:44.074729 9513 tablet_service.cc:1467] Processing CreateTablet for tablet aae5aeadd6ab416b8eb49b1916311599 (DEFAULT_TABLE table=test-table [id=c48b4a26a7c04c0cb26dfefad903a944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:44.075263 9513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aae5aeadd6ab416b8eb49b1916311599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:44.079850 10195 tablet_bootstrap.cc:492] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Bootstrap starting.
I20260809 00:46:44.081583 10195 tablet_bootstrap.cc:654] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:44.082088 9756 tablet_service.cc:1467] Processing CreateTablet for tablet aae5aeadd6ab416b8eb49b1916311599 (DEFAULT_TABLE table=test-table [id=c48b4a26a7c04c0cb26dfefad903a944]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:44.083417 9756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aae5aeadd6ab416b8eb49b1916311599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:44.088912 10192 tablet_bootstrap.cc:492] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Bootstrap starting.
I20260809 00:46:44.090502 10192 tablet_bootstrap.cc:654] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:44.091639 10227 raft_consensus.cc:2229] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:44.095441 10227 raft_consensus.cc:2258] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:44.099890 10195 tablet_bootstrap.cc:492] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: No bootstrap required, opened a new log
I20260809 00:46:44.100068 10195 ts_tablet_manager.cc:1397] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260809 00:46:44.100108 10227 ts_tablet_manager.cc:1905] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:44.100929 10195 raft_consensus.cc:348] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.101192 10195 raft_consensus.cc:374] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:44.101296 10195 raft_consensus.cc:729] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8491672baf9e4abfbeffa76ec771d0c8, State: Initialized, Role: FOLLOWER
I20260809 00:46:44.101572 10195 consensus_queue.cc:260] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.102294 10195 ts_tablet_manager.cc:1428] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 00:46:44.103024 10225 tablet_replica.cc:330] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: stopping tablet replica
I20260809 00:46:44.103480 10225 raft_consensus.cc:2229] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:44.103967 10225 raft_consensus.cc:2258] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:44.104797 10193 tablet_bootstrap.cc:492] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Bootstrap starting.
I20260809 00:46:44.106645 10225 ts_tablet_manager.cc:1905] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:44.106684 10193 tablet_bootstrap.cc:654] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:44.108924 10193 tablet_bootstrap.cc:492] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: No bootstrap required, opened a new log
I20260809 00:46:44.109163 10193 ts_tablet_manager.cc:1397] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260809 00:46:44.110181 10193 raft_consensus.cc:348] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.110476 10193 raft_consensus.cc:374] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:44.110646 10193 raft_consensus.cc:729] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Initialized, Role: FOLLOWER
I20260809 00:46:44.111059 10193 consensus_queue.cc:260] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.114032 10193 ts_tablet_manager.cc:1428] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 00:46:44.114166 10225 ts_tablet_manager.cc:1918] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:44.114333 10225 log.cc:1196] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/3af23c8dc2484730ad92a2db9ffa5a9c
I20260809 00:46:44.114902 10225 ts_tablet_manager.cc:1939] T 3af23c8dc2484730ad92a2db9ffa5a9c P 8491672baf9e4abfbeffa76ec771d0c8: Deleting consensus metadata
I20260809 00:46:44.115609 10227 ts_tablet_manager.cc:1918] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:44.115792 10227 log.cc:1196] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/3af23c8dc2484730ad92a2db9ffa5a9c
I20260809 00:46:44.116344 10227 ts_tablet_manager.cc:1939] T 3af23c8dc2484730ad92a2db9ffa5a9c P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting consensus metadata
I20260809 00:46:44.117676 9228 catalog_manager.cc:4841] TS 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025): tablet 3af23c8dc2484730ad92a2db9ffa5a9c (table test-table [id=5d0f82e5045a41d28d882320b09c0eb9]) successfully deleted
I20260809 00:46:44.119056 10223 tablet_replica.cc:330] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: stopping tablet replica
I20260809 00:46:44.119089 9223 catalog_manager.cc:4841] TS 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513): tablet 3af23c8dc2484730ad92a2db9ffa5a9c (table test-table [id=5d0f82e5045a41d28d882320b09c0eb9]) successfully deleted
I20260809 00:46:44.119333 10192 tablet_bootstrap.cc:492] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: No bootstrap required, opened a new log
I20260809 00:46:44.119506 10192 ts_tablet_manager.cc:1397] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.004s
I20260809 00:46:44.119720 10223 raft_consensus.cc:2229] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:44.120255 10223 raft_consensus.cc:2258] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:44.120419 10192 raft_consensus.cc:348] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.120658 10192 raft_consensus.cc:374] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:44.120771 10192 raft_consensus.cc:729] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Initialized, Role: FOLLOWER
I20260809 00:46:44.121022 10192 consensus_queue.cc:260] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.122121 10192 ts_tablet_manager.cc:1428] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260809 00:46:44.122762 10223 ts_tablet_manager.cc:1905] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:44.129729 10223 ts_tablet_manager.cc:1918] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:44.129894 10223 log.cc:1196] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/3af23c8dc2484730ad92a2db9ffa5a9c
I20260809 00:46:44.130441 10223 ts_tablet_manager.cc:1939] T 3af23c8dc2484730ad92a2db9ffa5a9c P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting consensus metadata
I20260809 00:46:44.132130 9222 catalog_manager.cc:4841] TS 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047): tablet 3af23c8dc2484730ad92a2db9ffa5a9c (table test-table [id=5d0f82e5045a41d28d882320b09c0eb9]) successfully deleted
I20260809 00:46:44.385910 10205 raft_consensus.cc:482] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:44.386174 10205 raft_consensus.cc:504] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.386876 10205 leader_election.cc:288] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:44.387488 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae5aeadd6ab416b8eb49b1916311599" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" is_pre_election: true
I20260809 00:46:44.387598 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae5aeadd6ab416b8eb49b1916311599" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8" is_pre_election: true
I20260809 00:46:44.387774 9557 raft_consensus.cc:2454] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 0.
I20260809 00:46:44.387835 10072 raft_consensus.cc:2454] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 0.
I20260809 00:46:44.388260 9672 leader_election.cc:302] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:44.388543 10205 raft_consensus.cc:2781] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:44.388645 10205 raft_consensus.cc:482] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:44.388759 10205 raft_consensus.cc:3037] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:44.391052 10205 raft_consensus.cc:504] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.391644 10205 leader_election.cc:288] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 election: Requested vote from peers 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:44.392081 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae5aeadd6ab416b8eb49b1916311599" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d68b9f7ea714f4c917ddbcf7181e913"
I20260809 00:46:44.392139 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aae5aeadd6ab416b8eb49b1916311599" candidate_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8"
I20260809 00:46:44.392305 9557 raft_consensus.cc:3037] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:44.392340 10072 raft_consensus.cc:3037] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:44.395222 10072 raft_consensus.cc:2454] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 1.
I20260809 00:46:44.395222 9557 raft_consensus.cc:2454] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85f7d0fe3e0242e4835fd0c92e23eddb in term 1.
I20260809 00:46:44.395627 9675 leader_election.cc:302] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8491672baf9e4abfbeffa76ec771d0c8, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:44.395984 10205 raft_consensus.cc:2781] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:44.396147 10205 raft_consensus.cc:686] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 LEADER]: Becoming Leader. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Running, Role: LEADER
I20260809 00:46:44.396373 10205 consensus_queue.cc:237] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.399118 9256 catalog_manager.cc:5495] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb reported cstate change: term changed from 0 to 1, leader changed from <none> to 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130). New cstate: current_term: 1 leader_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } health_report { overall_health: UNKNOWN } } }
Aug 09 00:46:44 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236400, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.190@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:44.484974 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.472179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36729 (local address 127.0.0.1:40188)
0809 00:46:44.472915 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:44.472932 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:44.473069 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:44.473360 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:44.473366 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:44.474052 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:44.474250 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.474259 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.475263 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.475267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.476235 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.476247 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.476961 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.476965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.477103 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.477867 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:44.477886 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:44.480044 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:44.482776 (+ 2732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:44.482788 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:44.482794 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:44.483229 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:44.483545 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:44.483548 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:44.483550 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:44.483689 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:44.484165 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:44.484171 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:44.484313 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 00:46:44.484457 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 00:46:44.484672 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":415,"threads_started":1}
I20260809 00:46:44.485118 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.472182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40188 (local address 127.28.92.190:36729)
0809 00:46:44.472893 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.472898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.473009 (+ 111us) server_negotiation.cc:407] Connection header received
0809 00:46:44.473170 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.473174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.473233 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.473322 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:44.474375 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.475138 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.476378 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.476815 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.476906 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.480213 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:44.480219 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:44.480222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:44.480251 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:44.482642 (+ 2391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:44.483327 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:44.483331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:44.483333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:44.483454 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:44.483773 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:44.483777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:44.483778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:44.484062 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:44.484165 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.484538 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.484789 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":552,"thread_start_us":318,"threads_started":1}
I20260809 00:46:44.489909 9256 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:40188:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 00:46:44.490883 9256 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:44.497370 9512 tablet_service.cc:1467] Processing CreateTablet for tablet 4f08db95895543ce986766b616ddb296 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3fbb5c140774dd0874ce17aca4c8a3d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:46:44.497542 9756 tablet_service.cc:1467] Processing CreateTablet for tablet 4f08db95895543ce986766b616ddb296 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3fbb5c140774dd0874ce17aca4c8a3d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:46:44.498065 9512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f08db95895543ce986766b616ddb296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:44.498126 9756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f08db95895543ce986766b616ddb296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:44.498066 10029 tablet_service.cc:1467] Processing CreateTablet for tablet 4f08db95895543ce986766b616ddb296 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3fbb5c140774dd0874ce17aca4c8a3d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 00:46:44.498577 10029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f08db95895543ce986766b616ddb296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:44.503580 10193 tablet_bootstrap.cc:492] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: Bootstrap starting.
I20260809 00:46:44.505229 10193 tablet_bootstrap.cc:654] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:44.505779 10195 tablet_bootstrap.cc:492] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: Bootstrap starting.
I20260809 00:46:44.506382 10192 tablet_bootstrap.cc:492] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: Bootstrap starting.
I20260809 00:46:44.507120 10195 tablet_bootstrap.cc:654] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:44.508106 10192 tablet_bootstrap.cc:654] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:44.509019 10195 tablet_bootstrap.cc:492] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: No bootstrap required, opened a new log
I20260809 00:46:44.509186 10195 ts_tablet_manager.cc:1397] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 00:46:44.509985 10195 raft_consensus.cc:348] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.510244 10195 raft_consensus.cc:374] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:44.510284 10192 tablet_bootstrap.cc:492] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: No bootstrap required, opened a new log
I20260809 00:46:44.510339 10195 raft_consensus.cc:729] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8491672baf9e4abfbeffa76ec771d0c8, State: Initialized, Role: FOLLOWER
I20260809 00:46:44.510450 10192 ts_tablet_manager.cc:1397] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260809 00:46:44.510632 10195 consensus_queue.cc:260] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.511111 10202 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.511171 10192 raft_consensus.cc:348] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.511445 10202 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.511473 10192 raft_consensus.cc:374] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:44.511547 10192 raft_consensus.cc:729] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Initialized, Role: FOLLOWER
I20260809 00:46:44.511773 10192 consensus_queue.cc:260] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.512343 10192 ts_tablet_manager.cc:1428] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260809 00:46:44.512259 10200 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.512619 10200 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.512899 10195 ts_tablet_manager.cc:1428] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 00:46:44.519207 10193 tablet_bootstrap.cc:492] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: No bootstrap required, opened a new log
I20260809 00:46:44.519405 10193 ts_tablet_manager.cc:1397] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.006s
I20260809 00:46:44.520171 10193 raft_consensus.cc:348] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.520455 10193 raft_consensus.cc:374] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:44.520533 10193 raft_consensus.cc:729] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Initialized, Role: FOLLOWER
I20260809 00:46:44.520773 10193 consensus_queue.cc:260] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.521373 10193 ts_tablet_manager.cc:1428] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 00:46:44.521308 10205 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.521622 10205 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.674575 10200 raft_consensus.cc:482] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:44.674794 10200 raft_consensus.cc:504] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.676307 10200 leader_election.cc:288] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:44.695367 10251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.676641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:38025 (local address 127.28.92.129:53695)
0809 00:46:44.688963 (+ 12322us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:44.688982 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:44.689114 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:44.689697 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:44.689702 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:44.689728 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:44.690077 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.690088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.691485 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.691489 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.692976 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.692989 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.694487 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.694493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.694676 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.694712 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:46:44.694808 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 00:46:44.694951 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12184,"mutex_wait_us":99,"thread_start_us":12713,"threads_started":1}
I20260809 00:46:44.695869 10254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.676755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:35715 (local address 127.28.92.130:34513)
0809 00:46:44.688838 (+ 12083us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.688845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.688867 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:46:44.688942 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.688960 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.689042 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.689143 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:44.690020 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.691068 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.693428 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.694599 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.694743 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.694822 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.695450 (+ 628us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.695615 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11955,"thread_start_us":12491,"threads_started":1}
I20260809 00:46:44.696296 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.676631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34513 (local address 127.28.92.129:35715)
0809 00:46:44.688586 (+ 11955us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:44.688610 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:44.688811 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:44.689417 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:44.689423 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:44.689451 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:44.689842 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.689855 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.691220 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.691225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.693254 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.693269 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.694801 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.694807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.694979 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.695012 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 00:46:44.695105 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 00:46:44.695235 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11775,"mutex_wait_us":1,"thread_start_us":12629,"threads_started":1}
I20260809 00:46:44.695420 10256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.676805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:53695 (local address 127.28.92.131:38025)
0809 00:46:44.689249 (+ 12444us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.689255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.689274 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:46:44.689341 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.689345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.689418 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.689532 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:44.690253 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.691351 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.693134 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.694317 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.694483 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.694559 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.694915 (+ 356us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.695057 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12324,"thread_start_us":12376,"threads_started":1}
I20260809 00:46:44.697139 9792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f08db95895543ce986766b616ddb296" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" is_pre_election: true
I20260809 00:46:44.697570 9792 raft_consensus.cc:2454] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 0.
I20260809 00:46:44.697696 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f08db95895543ce986766b616ddb296" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8" is_pre_election: true
I20260809 00:46:44.697955 10072 raft_consensus.cc:2454] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 0.
I20260809 00:46:44.698197 9411 leader_election.cc:302] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:44.698640 10200 raft_consensus.cc:2781] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:44.698767 10200 raft_consensus.cc:482] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:44.698865 10200 raft_consensus.cc:3037] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:44.701081 10200 raft_consensus.cc:504] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.701709 10200 leader_election.cc:288] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 election: Requested vote from peers 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:44.702198 9792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f08db95895543ce986766b616ddb296" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb"
I20260809 00:46:44.702275 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f08db95895543ce986766b616ddb296" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8"
I20260809 00:46:44.702385 9792 raft_consensus.cc:3037] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:44.702521 10072 raft_consensus.cc:3037] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:44.704427 9792 raft_consensus.cc:2454] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 1.
I20260809 00:46:44.704823 9411 leader_election.cc:302] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:44.705128 10200 raft_consensus.cc:2781] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:44.705407 10072 raft_consensus.cc:2454] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 1.
I20260809 00:46:44.705574 10200 raft_consensus.cc:686] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 LEADER]: Becoming Leader. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Running, Role: LEADER
I20260809 00:46:44.706272 10200 consensus_queue.cc:237] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:44.708194 10259 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: TxnStatusTablet state changed. Reason: New leader 6d68b9f7ea714f4c917ddbcf7181e913. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.708609 10259 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:46:44.709303 10262 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 00:46:44.709539 10262 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 00:46:44.710130 9255 catalog_manager.cc:5495] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260809 00:46:44.757405 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.750652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41047 (local address 127.0.0.1:60482)
0809 00:46:44.750965 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:44.750989 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:44.751133 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:44.751768 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:44.751771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:44.751780 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:46:44.751932 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.751939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.753435 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.753440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.754558 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.754572 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.755563 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.755567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.755707 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.755762 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.756930 (+ 1168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.756958 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 00:46:44.757027 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 00:46:44.757168 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 00:46:44.757763 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.750572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.28.92.129:41047)
0809 00:46:44.751343 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.751349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.751374 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:46:44.751487 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.751492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.751594 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.751765 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:44.752053 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.753316 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.754696 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.755399 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.755558 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.755985 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.756779 (+ 794us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.756976 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.757091 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.757182 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":472,"threads_started":1}
I20260809 00:46:44.762444 10072 raft_consensus.cc:1261] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Refusing update from remote peer 6d68b9f7ea714f4c917ddbcf7181e913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:44.762730 9792 raft_consensus.cc:1261] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Refusing update from remote peer 6d68b9f7ea714f4c917ddbcf7181e913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:44.763127 10259 consensus_queue.cc:1035] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:44.763474 10200 consensus_queue.cc:1035] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:44.770238 10202 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: TxnStatusTablet state changed. Reason: New leader 6d68b9f7ea714f4c917ddbcf7181e913. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.770514 10202 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.774319 10269 mvcc.cc:205] Tried to move back new op lower bound from 7316424313899409408 to 7316424313680400384. Current Snapshot: MvccSnapshot[applied={T|T < 7316424313899409408}]
I20260809 00:46:44.774425 10199 consensus_queue.cc:1035] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:44.782125 10259 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.782431 10259 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:46:44.790409 10205 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: TxnStatusTablet state changed. Reason: New leader 6d68b9f7ea714f4c917ddbcf7181e913. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.790755 10205 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.794293 10200 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.794588 10200 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 6d68b9f7ea714f4c917ddbcf7181e913: This TxnStatusTablet replica's current role is: LEADER
I20260809 00:46:44.802891 10267 mvcc.cc:205] Tried to move back new op lower bound from 7316424313899409408 to 7316424313680400384. Current Snapshot: MvccSnapshot[applied={T|T < 7316424313899409408 or (T in {7316424313899409408})}]
I20260809 00:46:44.808710 10205 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.809038 10205 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 85f7d0fe3e0242e4835fd0c92e23eddb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.815795 10202 tablet_replica.cc:439] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } } }
I20260809 00:46:44.816066 10202 tablet_replica.cc:442] T 4f08db95895543ce986766b616ddb296 P 8491672baf9e4abfbeffa76ec771d0c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 00:46:44.819546 10199 consensus_queue.cc:1035] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:44.838364 10292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.828274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41047 (local address 127.28.92.130:55719)
0809 00:46:44.833111 (+ 4837us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:44.833128 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:44.833246 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:44.833583 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:44.833589 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:44.833602 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:46:44.833903 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.833913 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.835308 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.835312 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.836346 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.836358 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.837301 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.837305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.837413 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.837478 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.837905 (+ 427us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.837913 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 00:46:44.837973 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 00:46:44.838072 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4685,"thread_start_us":4563,"threads_started":1}
I20260809 00:46:44.838368 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.828674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:55719 (local address 127.28.92.129:41047)
0809 00:46:44.828853 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.828860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.833215 (+ 4355us) server_negotiation.cc:407] Connection header received
0809 00:46:44.833368 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.833373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.833460 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.833554 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:44.834051 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.835182 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.836484 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.837163 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.837295 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.837648 (+ 353us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.837802 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.837906 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.838007 (+ 101us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.838081 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:46:44.899554 10254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.885091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:40413 (local address 127.28.92.130:34513)
0809 00:46:44.885310 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:44.885316 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:44.892454 (+ 7138us) server_negotiation.cc:407] Connection header received
0809 00:46:44.892651 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:44.892657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:44.892754 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:44.892862 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:44.893571 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.894703 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.897275 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.897978 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.898077 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.898797 (+ 720us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.898943 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.899042 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:44.899175 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 00:46:44.899276 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:46:44.899767 10302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:44.884522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34513 (local address 127.28.92.129:40413)
0809 00:46:44.892303 (+ 7781us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:44.892329 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:44.892503 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:44.892885 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:44.892890 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:44.892902 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:46:44.893357 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.893370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.895051 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.895057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.897087 (+ 2030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:44.897105 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:44.898291 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:44.898298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:44.898485 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:44.898584 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:46:44.899053 (+ 469us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:46:44.899065 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 00:46:44.899141 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 00:46:44.899309 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7529,"thread_start_us":7351,"threads_started":1}
I20260809 00:46:44.938616 9255 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:44.938851 9255 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55126:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:44.942044 9255 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Sending DeleteTablet for 3 replicas of tablet aae5aeadd6ab416b8eb49b1916311599
I20260809 00:46:44.942801 9512 tablet_service.cc:1514] Processing DeleteTablet for tablet aae5aeadd6ab416b8eb49b1916311599 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:44 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60468
I20260809 00:46:44.943101 9756 tablet_service.cc:1514] Processing DeleteTablet for tablet aae5aeadd6ab416b8eb49b1916311599 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:44 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:54326
I20260809 00:46:44.943187 10029 tablet_service.cc:1514] Processing DeleteTablet for tablet aae5aeadd6ab416b8eb49b1916311599 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:44 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:48064
I20260809 00:46:44.953055 10306 tablet_replica.cc:330] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: stopping tablet replica
I20260809 00:46:44.953366 10304 tablet_replica.cc:330] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: stopping tablet replica
I20260809 00:46:44.953419 10306 raft_consensus.cc:2229] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:44.953579 10304 raft_consensus.cc:2229] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:44.953893 10304 raft_consensus.cc:2258] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:44.953903 10306 raft_consensus.cc:2258] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:44.954980 10306 ts_tablet_manager.cc:1905] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:44.958243 10304 ts_tablet_manager.cc:1905] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:44.961457 10306 ts_tablet_manager.cc:1918] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:46:44.961748 10306 log.cc:1196] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/aae5aeadd6ab416b8eb49b1916311599
I20260809 00:46:44.962275 10306 ts_tablet_manager.cc:1939] T aae5aeadd6ab416b8eb49b1916311599 P 8491672baf9e4abfbeffa76ec771d0c8: Deleting consensus metadata
I20260809 00:46:44.963515 9228 catalog_manager.cc:4841] TS 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025): tablet aae5aeadd6ab416b8eb49b1916311599 (table test-table [id=c48b4a26a7c04c0cb26dfefad903a944]) successfully deleted
I20260809 00:46:44.965322 10304 ts_tablet_manager.cc:1918] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:46:44.965444 10304 log.cc:1196] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/aae5aeadd6ab416b8eb49b1916311599
I20260809 00:46:44.965894 10304 ts_tablet_manager.cc:1939] T aae5aeadd6ab416b8eb49b1916311599 P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting consensus metadata
I20260809 00:46:44.966887 9222 catalog_manager.cc:4841] TS 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047): tablet aae5aeadd6ab416b8eb49b1916311599 (table test-table [id=c48b4a26a7c04c0cb26dfefad903a944]) successfully deleted
I20260809 00:46:44.970222 10305 tablet_replica.cc:330] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: stopping tablet replica
I20260809 00:46:44.970530 10305 raft_consensus.cc:2229] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:44.970971 10305 raft_consensus.cc:2258] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:44.972127 10305 ts_tablet_manager.cc:1905] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:44.979141 10305 ts_tablet_manager.cc:1918] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:46:44.979303 10305 log.cc:1196] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/aae5aeadd6ab416b8eb49b1916311599
I20260809 00:46:44.979704 10305 ts_tablet_manager.cc:1939] T aae5aeadd6ab416b8eb49b1916311599 P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting consensus metadata
I20260809 00:46:44.980799 9223 catalog_manager.cc:4841] TS 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513): tablet aae5aeadd6ab416b8eb49b1916311599 (table test-table [id=c48b4a26a7c04c0cb26dfefad903a944]) successfully deleted
Aug 09 00:46:44 dist-test-slave-t7g5 krb5kdc[9161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 00:46:45 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:45 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 00:46:45.015369 10321 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:45.003145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40202 (local address 127.28.92.190:36729)
0809 00:46:45.003657 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.003664 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.003999 (+ 335us) server_negotiation.cc:407] Connection header received
0809 00:46:45.004158 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.004164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.004263 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.004390 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:45.005758 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.006974 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.008432 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.009091 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.009226 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.015009 (+ 5783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40202: BlockingRecv error: recv got EOF from 127.0.0.1:40202 (error 108)
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":245,"threads_started":1}
Aug 09 00:46:45 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM
I20260809 00:46:45.045523 10321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.018034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40204 (local address 127.28.92.190:36729)
0809 00:46:45.018227 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.018233 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.018605 (+ 372us) server_negotiation.cc:407] Connection header received
0809 00:46:45.018797 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.018802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.018868 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.018952 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:45.020217 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.021021 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.032610 (+ 11589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.033420 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.033600 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.038781 (+ 5181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:45.038788 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:45.038794 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:45.038841 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:45.042311 (+ 3470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:45.043175 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:45.043181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:45.043185 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:45.043363 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:45.043800 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:45.043804 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:45.043808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:45.044140 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:45.044409 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.044761 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.044990 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:46:45.049932 9255 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:45.050652 9255 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:45.057855 9512 tablet_service.cc:1467] Processing CreateTablet for tablet 3a18f82d07d94027a0a16cd9ad4060cd (DEFAULT_TABLE table=test-table [id=6114c4a3f71e495f8b8d93e36f164bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:45.058374 9512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a18f82d07d94027a0a16cd9ad4060cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:45.058283 10029 tablet_service.cc:1467] Processing CreateTablet for tablet 3a18f82d07d94027a0a16cd9ad4060cd (DEFAULT_TABLE table=test-table [id=6114c4a3f71e495f8b8d93e36f164bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:45.058279 9756 tablet_service.cc:1467] Processing CreateTablet for tablet 3a18f82d07d94027a0a16cd9ad4060cd (DEFAULT_TABLE table=test-table [id=6114c4a3f71e495f8b8d93e36f164bc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:45.058702 10029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a18f82d07d94027a0a16cd9ad4060cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:45.058702 9756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a18f82d07d94027a0a16cd9ad4060cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:45.069010 10339 tablet_bootstrap.cc:492] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Bootstrap starting.
I20260809 00:46:45.070472 10338 tablet_bootstrap.cc:492] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Bootstrap starting.
I20260809 00:46:45.072124 10338 tablet_bootstrap.cc:654] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:45.072131 10339 tablet_bootstrap.cc:654] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:45.074716 10339 tablet_bootstrap.cc:492] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: No bootstrap required, opened a new log
I20260809 00:46:45.074889 10339 ts_tablet_manager.cc:1397] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 00:46:45.075831 10339 raft_consensus.cc:348] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.076112 10339 raft_consensus.cc:374] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:45.076213 10339 raft_consensus.cc:729] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Initialized, Role: FOLLOWER
I20260809 00:46:45.076584 10332 tablet_bootstrap.cc:492] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Bootstrap starting.
I20260809 00:46:45.076541 10339 consensus_queue.cc:260] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.077126 10339 ts_tablet_manager.cc:1428] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 00:46:45.078931 10332 tablet_bootstrap.cc:654] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:45.080518 10338 tablet_bootstrap.cc:492] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: No bootstrap required, opened a new log
I20260809 00:46:45.080686 10338 ts_tablet_manager.cc:1397] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260809 00:46:45.081545 10338 raft_consensus.cc:348] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.081908 10338 raft_consensus.cc:374] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:45.082062 10338 raft_consensus.cc:729] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8491672baf9e4abfbeffa76ec771d0c8, State: Initialized, Role: FOLLOWER
I20260809 00:46:45.082297 10338 consensus_queue.cc:260] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.082840 10338 ts_tablet_manager.cc:1428] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 00:46:45.083348 10332 tablet_bootstrap.cc:492] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: No bootstrap required, opened a new log
I20260809 00:46:45.083492 10332 ts_tablet_manager.cc:1397] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 00:46:45.084108 10332 raft_consensus.cc:348] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.084307 10332 raft_consensus.cc:374] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:45.084406 10332 raft_consensus.cc:729] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Initialized, Role: FOLLOWER
I20260809 00:46:45.084630 10332 consensus_queue.cc:260] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.085078 10332 ts_tablet_manager.cc:1428] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260809 00:46:45.255299 10259 raft_consensus.cc:482] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:45.255518 10259 raft_consensus.cc:504] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.256109 10259 leader_election.cc:288] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:45.256736 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a18f82d07d94027a0a16cd9ad4060cd" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8" is_pre_election: true
I20260809 00:46:45.256754 9790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a18f82d07d94027a0a16cd9ad4060cd" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" is_pre_election: true
I20260809 00:46:45.256976 10072 raft_consensus.cc:2454] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 0.
I20260809 00:46:45.257016 9790 raft_consensus.cc:2454] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 0.
I20260809 00:46:45.257469 9411 leader_election.cc:302] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 8491672baf9e4abfbeffa76ec771d0c8, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:45.257850 10259 raft_consensus.cc:2781] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:45.257957 10259 raft_consensus.cc:482] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:45.258071 10259 raft_consensus.cc:3037] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:45.260421 10259 raft_consensus.cc:504] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.260957 10259 leader_election.cc:288] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 election: Requested vote from peers 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:45.261364 9790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a18f82d07d94027a0a16cd9ad4060cd" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb"
I20260809 00:46:45.261390 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a18f82d07d94027a0a16cd9ad4060cd" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8"
I20260809 00:46:45.261546 9790 raft_consensus.cc:3037] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:45.261590 10072 raft_consensus.cc:3037] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:45.263548 9790 raft_consensus.cc:2454] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 1.
I20260809 00:46:45.263726 10072 raft_consensus.cc:2454] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 1.
I20260809 00:46:45.263940 9411 leader_election.cc:302] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 85f7d0fe3e0242e4835fd0c92e23eddb; no voters:
I20260809 00:46:45.264194 10259 raft_consensus.cc:2781] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:45.264348 10259 raft_consensus.cc:686] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 LEADER]: Becoming Leader. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Running, Role: LEADER
I20260809 00:46:45.264580 10259 consensus_queue.cc:237] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.267061 9255 catalog_manager.cc:5495] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260809 00:46:45.315936 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.311143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60498 (local address 127.28.92.129:41047)
0809 00:46:45.311343 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.311349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.311432 (+ 83us) server_negotiation.cc:407] Connection header received
0809 00:46:45.311662 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.311666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.311740 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.311841 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:45.312198 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.312893 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.314278 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.314705 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.314820 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.315236 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:45.315366 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:45.315455 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.315589 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.315673 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:46:45.318990 9790 raft_consensus.cc:1261] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Refusing update from remote peer 6d68b9f7ea714f4c917ddbcf7181e913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:45.318995 10072 raft_consensus.cc:1261] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Refusing update from remote peer 6d68b9f7ea714f4c917ddbcf7181e913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:45.319619 10295 consensus_queue.cc:1035] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:45.319917 10259 consensus_queue.cc:1035] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:45.334897 9253 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:45.335116 9253 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:45.338068 9253 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Sending DeleteTablet for 3 replicas of tablet 3a18f82d07d94027a0a16cd9ad4060cd
I20260809 00:46:45.338917 9756 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a18f82d07d94027a0a16cd9ad4060cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:45 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:54326
I20260809 00:46:45.339061 9512 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a18f82d07d94027a0a16cd9ad4060cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:45 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60468
I20260809 00:46:45.339223 10305 tablet_replica.cc:330] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: stopping tablet replica
I20260809 00:46:45.339329 10304 tablet_replica.cc:330] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: stopping tablet replica
I20260809 00:46:45.339427 10305 raft_consensus.cc:2229] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:45.339552 10304 raft_consensus.cc:2229] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:45.339684 10305 raft_consensus.cc:2258] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:45.340080 10304 raft_consensus.cc:2258] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:45.340829 10305 ts_tablet_manager.cc:1905] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:45.341179 10029 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a18f82d07d94027a0a16cd9ad4060cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:45 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:48064
I20260809 00:46:45.341473 10306 tablet_replica.cc:330] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: stopping tablet replica
I20260809 00:46:45.341696 10306 raft_consensus.cc:2229] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:45.341922 10306 raft_consensus.cc:2258] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:45.342633 10304 ts_tablet_manager.cc:1905] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:45.346443 10306 ts_tablet_manager.cc:1905] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:45.347566 10305 ts_tablet_manager.cc:1918] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:45.347790 10305 log.cc:1196] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/3a18f82d07d94027a0a16cd9ad4060cd
I20260809 00:46:45.348292 10305 ts_tablet_manager.cc:1939] T 3a18f82d07d94027a0a16cd9ad4060cd P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting consensus metadata
I20260809 00:46:45.349294 10304 ts_tablet_manager.cc:1918] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:45.349490 10304 log.cc:1196] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/3a18f82d07d94027a0a16cd9ad4060cd
I20260809 00:46:45.349536 9223 catalog_manager.cc:4841] TS 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513): tablet 3a18f82d07d94027a0a16cd9ad4060cd (table test-table [id=6114c4a3f71e495f8b8d93e36f164bc6]) successfully deleted
I20260809 00:46:45.349956 10304 ts_tablet_manager.cc:1939] T 3a18f82d07d94027a0a16cd9ad4060cd P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting consensus metadata
I20260809 00:46:45.351007 9222 catalog_manager.cc:4841] TS 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047): tablet 3a18f82d07d94027a0a16cd9ad4060cd (table test-table [id=6114c4a3f71e495f8b8d93e36f164bc6]) successfully deleted
I20260809 00:46:45.351100 9253 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:46:45.351752 9253 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:46:45.352942 10306 ts_tablet_manager.cc:1918] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:46:45.353101 10306 log.cc:1196] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/3a18f82d07d94027a0a16cd9ad4060cd
I20260809 00:46:45.353492 10306 ts_tablet_manager.cc:1939] T 3a18f82d07d94027a0a16cd9ad4060cd P 8491672baf9e4abfbeffa76ec771d0c8: Deleting consensus metadata
I20260809 00:46:45.354682 9228 catalog_manager.cc:4841] TS 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025): tablet 3a18f82d07d94027a0a16cd9ad4060cd (table test-table [id=6114c4a3f71e495f8b8d93e36f164bc6]) successfully deleted
I20260809 00:46:45.359874 9512 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7e58b2fb594b74b96ea89e70534cec (DEFAULT_TABLE table=test-table [id=d3dffd6be6be46b3bb4b18252c854952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:45.359997 9756 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7e58b2fb594b74b96ea89e70534cec (DEFAULT_TABLE table=test-table [id=d3dffd6be6be46b3bb4b18252c854952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:45.360329 9512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7e58b2fb594b74b96ea89e70534cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:45.360390 9756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7e58b2fb594b74b96ea89e70534cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:45.365113 10332 tablet_bootstrap.cc:492] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Bootstrap starting.
I20260809 00:46:45.366540 10332 tablet_bootstrap.cc:654] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:45.367432 10339 tablet_bootstrap.cc:492] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Bootstrap starting.
I20260809 00:46:45.367615 10029 tablet_service.cc:1467] Processing CreateTablet for tablet 1c7e58b2fb594b74b96ea89e70534cec (DEFAULT_TABLE table=test-table [id=d3dffd6be6be46b3bb4b18252c854952]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:46:45.368021 10029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c7e58b2fb594b74b96ea89e70534cec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:45.369104 10339 tablet_bootstrap.cc:654] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:45.371505 10339 tablet_bootstrap.cc:492] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: No bootstrap required, opened a new log
I20260809 00:46:45.371685 10339 ts_tablet_manager.cc:1397] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.003s
I20260809 00:46:45.372468 10339 raft_consensus.cc:348] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.372720 10339 raft_consensus.cc:374] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:45.372809 10339 raft_consensus.cc:729] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Initialized, Role: FOLLOWER
I20260809 00:46:45.373076 10339 consensus_queue.cc:260] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.373682 10339 ts_tablet_manager.cc:1428] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 00:46:45.374141 10338 tablet_bootstrap.cc:492] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Bootstrap starting.
I20260809 00:46:45.375779 10338 tablet_bootstrap.cc:654] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:45.383842 10332 tablet_bootstrap.cc:492] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: No bootstrap required, opened a new log
I20260809 00:46:45.384055 10332 ts_tablet_manager.cc:1397] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.011s
I20260809 00:46:45.385037 10332 raft_consensus.cc:348] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.385308 10332 raft_consensus.cc:374] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:45.385471 10338 tablet_bootstrap.cc:492] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: No bootstrap required, opened a new log
I20260809 00:46:45.385622 10338 ts_tablet_manager.cc:1397] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.008s
I20260809 00:46:45.386456 10338 raft_consensus.cc:348] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.386716 10338 raft_consensus.cc:374] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:45.386806 10338 raft_consensus.cc:729] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8491672baf9e4abfbeffa76ec771d0c8, State: Initialized, Role: FOLLOWER
I20260809 00:46:45.387121 10338 consensus_queue.cc:260] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.385399 10332 raft_consensus.cc:729] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85f7d0fe3e0242e4835fd0c92e23eddb, State: Initialized, Role: FOLLOWER
I20260809 00:46:45.388312 10338 ts_tablet_manager.cc:1428] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260809 00:46:45.389010 10332 consensus_queue.cc:260] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.389689 10332 ts_tablet_manager.cc:1428] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260809 00:46:45.516758 10202 raft_consensus.cc:482] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:45.517027 10202 raft_consensus.cc:504] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.518992 10202 leader_election.cc:288] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047), 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513)
I20260809 00:46:45.522377 10200 raft_consensus.cc:482] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:46:45.522605 10200 raft_consensus.cc:504] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.524344 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7e58b2fb594b74b96ea89e70534cec" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8" is_pre_election: true
I20260809 00:46:45.524629 10072 raft_consensus.cc:2454] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 0.
I20260809 00:46:45.525327 9420 leader_election.cc:302] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 8491672baf9e4abfbeffa76ec771d0c8; no voters:
I20260809 00:46:45.525640 10295 raft_consensus.cc:2781] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:46:45.525774 10295 raft_consensus.cc:482] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:46:45.525884 10295 raft_consensus.cc:3037] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:45.529090 10295 raft_consensus.cc:504] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.523383 10200 leader_election.cc:288] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:45.530560 10072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7e58b2fb594b74b96ea89e70534cec" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8491672baf9e4abfbeffa76ec771d0c8"
I20260809 00:46:45.530838 10072 raft_consensus.cc:3037] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:45.534126 10072 raft_consensus.cc:2454] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 1.
I20260809 00:46:45.534598 9420 leader_election.cc:302] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d68b9f7ea714f4c917ddbcf7181e913, 8491672baf9e4abfbeffa76ec771d0c8; no voters:
I20260809 00:46:45.534894 10200 raft_consensus.cc:2781] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:45.535058 10200 raft_consensus.cc:686] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 LEADER]: Becoming Leader. State: Replica: 6d68b9f7ea714f4c917ddbcf7181e913, State: Running, Role: LEADER
I20260809 00:46:45.535313 10200 consensus_queue.cc:237] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } }
I20260809 00:46:45.537297 10295 leader_election.cc:288] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [CANDIDATE]: Term 1 election: Requested vote from peers 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513), 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025)
I20260809 00:46:45.537905 9790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7e58b2fb594b74b96ea89e70534cec" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" is_pre_election: true
I20260809 00:46:45.538131 9790 raft_consensus.cc:2454] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 0.
I20260809 00:46:45.538655 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.519917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:33945 (local address 127.28.92.129:41047)
0809 00:46:45.520258 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.520265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.531345 (+ 11080us) server_negotiation.cc:407] Connection header received
0809 00:46:45.531632 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.531638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.531712 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.531767 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:45.532526 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.533623 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.536086 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.537466 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.537600 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.537696 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.538230 (+ 534us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.538374 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186}
I20260809 00:46:45.538688 9790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7e58b2fb594b74b96ea89e70534cec" candidate_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb"
I20260809 00:46:45.538856 9790 raft_consensus.cc:3037] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:45.539398 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.519094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41047 (local address 127.28.92.131:33945)
0809 00:46:45.531219 (+ 12125us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:45.531250 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:45.531468 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:45.531985 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:45.531990 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:45.532016 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:45.532311 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:45.532322 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.533849 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.533854 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:45.535875 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:45.535890 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.537843 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.537850 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:45.538045 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.538080 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 00:46:45.538876 (+ 796us) client_negotiation.cc:240] Negotiation successful
0809 00:46:45.539098 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11982,"threads_started":1}
I20260809 00:46:45.542095 9790 raft_consensus.cc:2454] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in term 1.
I20260809 00:46:45.549221 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.519491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34513 (local address 127.28.92.131:54929)
0809 00:46:45.539664 (+ 20173us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:45.539684 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:45.539787 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:45.543416 (+ 3629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:45.543421 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:45.543448 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:46:45.543602 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:45.543612 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.545063 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.545068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:45.546820 (+ 1752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:45.546836 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.548409 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.548416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:45.548615 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.548653 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 00:46:45.548726 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 00:46:45.548878 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20037,"thread_start_us":11470,"threads_started":1}
I20260809 00:46:45.550405 10362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.520457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:54929 (local address 127.28.92.130:34513)
0809 00:46:45.543108 (+ 22651us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.543115 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.543134 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:46:45.543192 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.543197 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.543266 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.543735 (+ 469us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:46:45.543915 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.544896 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.547040 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.548219 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.549830 (+ 1611us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.549907 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.549960 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.550099 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16847,"thread_start_us":16964,"threads_started":1}
I20260809 00:46:45.551066 9790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7e58b2fb594b74b96ea89e70534cec" candidate_uuid: "8491672baf9e4abfbeffa76ec771d0c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" is_pre_election: true
I20260809 00:46:45.551396 9790 raft_consensus.cc:2379] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8491672baf9e4abfbeffa76ec771d0c8 in current term 1: Already voted for candidate 6d68b9f7ea714f4c917ddbcf7181e913 in this term.
I20260809 00:46:45.554821 9557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c7e58b2fb594b74b96ea89e70534cec" candidate_uuid: "8491672baf9e4abfbeffa76ec771d0c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" is_pre_election: true
I20260809 00:46:45.554633 9253 catalog_manager.cc:5495] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d68b9f7ea714f4c917ddbcf7181e913" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 41047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 } health_report { overall_health: UNKNOWN } } }
I20260809 00:46:45.555630 9935 leader_election.cc:302] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8491672baf9e4abfbeffa76ec771d0c8; no voters: 6d68b9f7ea714f4c917ddbcf7181e913, 85f7d0fe3e0242e4835fd0c92e23eddb
I20260809 00:46:45.556079 10202 raft_consensus.cc:2726] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 00:46:45.629431 10372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.623078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:41047 (local address 127.28.92.129:60483)
0809 00:46:45.623753 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:45.623776 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:45.623916 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:45.624256 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:45.624260 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:45.624272 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 00:46:45.624586 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:45.624596 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.626056 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.626060 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:45.627224 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:45.627237 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.628285 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.628290 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:45.628407 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.628442 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 00:46:45.628838 (+ 396us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 00:46:45.628847 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 00:46:45.628909 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 00:46:45.629045 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":2,"thread_start_us":374,"threads_started":1}
I20260809 00:46:45.629459 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.623047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:60483 (local address 127.28.92.129:41047)
0809 00:46:45.623270 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.623276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.623868 (+ 592us) server_negotiation.cc:407] Connection header received
0809 00:46:45.624044 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.624049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.624132 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.624265 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:46:45.624769 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.625930 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.627367 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.628109 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.628249 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.628595 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:46:45.628738 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:46:45.628845 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.628942 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.629070 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":64}
I20260809 00:46:45.638092 10072 raft_consensus.cc:1261] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Refusing update from remote peer 6d68b9f7ea714f4c917ddbcf7181e913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:45.638621 9790 raft_consensus.cc:1261] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Refusing update from remote peer 6d68b9f7ea714f4c917ddbcf7181e913: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:46:45.638638 10200 consensus_queue.cc:1035] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8491672baf9e4abfbeffa76ec771d0c8" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 38025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:45.639240 10259 consensus_queue.cc:1035] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85f7d0fe3e0242e4835fd0c92e23eddb" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:46:45.712026 9255 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:45.712270 9255 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:46:45.715390 9255 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 07837afddef8425cbed6b0c29f4c9e1a: Sending DeleteTablet for 3 replicas of tablet 1c7e58b2fb594b74b96ea89e70534cec
I20260809 00:46:45.716588 9512 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c7e58b2fb594b74b96ea89e70534cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:45 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:60468
I20260809 00:46:45.716912 10029 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c7e58b2fb594b74b96ea89e70534cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:45 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:48064
I20260809 00:46:45.717224 10304 tablet_replica.cc:330] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: stopping tablet replica
I20260809 00:46:45.717417 10304 raft_consensus.cc:2229] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:46:45.717794 10304 raft_consensus.cc:2258] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:45.718097 10306 tablet_replica.cc:330] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: stopping tablet replica
I20260809 00:46:45.718278 10306 raft_consensus.cc:2229] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:45.718454 10306 raft_consensus.cc:2258] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:45.719532 10306 ts_tablet_manager.cc:1905] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:45.724589 10304 ts_tablet_manager.cc:1905] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:45.724879 10306 ts_tablet_manager.cc:1918] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:46:45.724998 10306 log.cc:1196] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/1c7e58b2fb594b74b96ea89e70534cec
I20260809 00:46:45.725392 10306 ts_tablet_manager.cc:1939] T 1c7e58b2fb594b74b96ea89e70534cec P 8491672baf9e4abfbeffa76ec771d0c8: Deleting consensus metadata
I20260809 00:46:45.726393 9228 catalog_manager.cc:4841] TS 8491672baf9e4abfbeffa76ec771d0c8 (127.28.92.131:38025): tablet 1c7e58b2fb594b74b96ea89e70534cec (table test-table [id=d3dffd6be6be46b3bb4b18252c854952]) successfully deleted
I20260809 00:46:45.730165 9756 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c7e58b2fb594b74b96ea89e70534cec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:46:45 UTC) from {username='oryx', principal='oryx/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:54326
I20260809 00:46:45.730523 10305 tablet_replica.cc:330] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: stopping tablet replica
I20260809 00:46:45.730717 10305 raft_consensus.cc:2229] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:46:45.730962 10305 raft_consensus.cc:2258] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:46:45.730981 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 9375
I20260809 00:46:45.732116 10304 ts_tablet_manager.cc:1918] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:46:45.732272 10304 log.cc:1196] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/1c7e58b2fb594b74b96ea89e70534cec
I20260809 00:46:45.732694 10304 ts_tablet_manager.cc:1939] T 1c7e58b2fb594b74b96ea89e70534cec P 6d68b9f7ea714f4c917ddbcf7181e913: Deleting consensus metadata
I20260809 00:46:45.733456 10305 ts_tablet_manager.cc:1905] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:46:45.733966 9222 catalog_manager.cc:4841] TS 6d68b9f7ea714f4c917ddbcf7181e913 (127.28.92.129:41047): tablet 1c7e58b2fb594b74b96ea89e70534cec (table test-table [id=d3dffd6be6be46b3bb4b18252c854952]) successfully deleted
I20260809 00:46:45.739619 10305 ts_tablet_manager.cc:1918] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 00:46:45.739775 10305 log.cc:1196] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/1c7e58b2fb594b74b96ea89e70534cec
I20260809 00:46:45.740190 10305 ts_tablet_manager.cc:1939] T 1c7e58b2fb594b74b96ea89e70534cec P 85f7d0fe3e0242e4835fd0c92e23eddb: Deleting consensus metadata
I20260809 00:46:45.741346 9223 catalog_manager.cc:4841] TS 85f7d0fe3e0242e4835fd0c92e23eddb (127.28.92.130:34513): tablet 1c7e58b2fb594b74b96ea89e70534cec (table test-table [id=d3dffd6be6be46b3bb4b18252c854952]) successfully deleted
Aug 09 00:46:45 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.129@KRBTEST.COM
I20260809 00:46:45.751462 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.732392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60506 (local address 127.28.92.129:41047)
0809 00:46:45.732602 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.732607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.734884 (+ 2277us) server_negotiation.cc:407] Connection header received
0809 00:46:45.735065 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.735071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.735155 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.735275 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:45.736792 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.737910 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.739691 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.740407 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.740523 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.744631 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:45.744651 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:45.744675 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:45.744723 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:45.748631 (+ 3908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:45.749303 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:45.749314 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:45.749318 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:45.749486 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:45.749850 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:45.749854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:45.749858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:45.750351 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:45.750689 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.750884 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.751126 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 00:46:45.752192 9618 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:45.915091 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 9375
I20260809 00:46:45.954041 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 9632
Aug 09 00:46:45 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.130@KRBTEST.COM
I20260809 00:46:45.973394 10362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:45.955010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54356 (local address 127.28.92.130:34513)
0809 00:46:45.955257 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:45.955262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:45.955319 (+ 57us) server_negotiation.cc:407] Connection header received
0809 00:46:45.955573 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:45.955584 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:45.955702 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:45.955807 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:45.957396 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.958473 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.960124 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:45.960648 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:45.960813 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:45.966179 (+ 5366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:45.966199 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:45.966217 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:45.966265 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:45.969604 (+ 3339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:45.970502 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:45.970516 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:45.970520 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:45.970707 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:45.971160 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:45.971167 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:45.971170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:45.971676 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:45.972242 (+ 566us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:45.972654 (+ 412us) server_negotiation.cc:299] Negotiation successful
0809 00:46:45.972996 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 00:46:45.974298 9881 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:46.132153 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 9632
I20260809 00:46:46.168469 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 9903
Aug 09 00:46:46 dist-test-slave-t7g5 krb5kdc[9161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.28.92.131@KRBTEST.COM
I20260809 00:46:46.187863 10386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:46.169456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48072 (local address 127.28.92.131:38025)
0809 00:46:46.170046 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:46.170054 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:46.170075 (+ 21us) server_negotiation.cc:407] Connection header received
0809 00:46:46.170144 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:46.170148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:46.170224 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:46.170356 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:46.172158 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:46.173015 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:46.174604 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:46.175186 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:46.175331 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:46.180723 (+ 5392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:46.180744 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:46.180766 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:46.180815 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:46.184552 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:46.185356 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:46.185364 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:46.185367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:46.185571 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:46.186016 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:46.186020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:46.186023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:46.186525 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:46.186814 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:46.187120 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 00:46:46.187371 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":312,"threads_started":1}
I20260809 00:46:46.188721 10142 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:46.317809 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 9903
I20260809 00:46:46.348106 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 9192
I20260809 00:46:46.349602 9323 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:46.495442 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 9192
2026-08-09T00:46:46Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7544 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:46 dist-test-slave-t7g5 krb5kdc[10394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:46 dist-test-slave-t7g5 krb5kdc[10394](info): set up 2 sockets
Aug 09 00:46:46 dist-test-slave-t7g5 krb5kdc[10394](info): commencing operation
krb5kdc: starting...
W20260809 00:46:48.121634 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.564s user 0.003s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:48 dist-test-slave-t7g5 krb5kdc[10394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:48.439678 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:32839
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:34541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:32839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:48.779072 10422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:48.779354 10422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:48.779487 10422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:48.786489 10422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:48.786595 10422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:48.786671 10422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:48.786746 10422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:48.786811 10422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:48.797016 10422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:32839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:32839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:48.798377 10422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:48.799692 10422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:48.811131 10431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:48.811162 10451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:48.811206 10438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:48.812071 10422 server_base.cc:1034] running on GCE node
I20260809 00:46:48.812842 10422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:48.814272 10422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:48.815490 10422 hybrid_clock.cc:648] HybridClock initialized: now 1786236408815431 us; error 37 us; skew 500 ppm
I20260809 00:46:48.815819 10422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T00:46:48Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2379 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:46:48 dist-test-slave-t7g5 krb5kdc[10459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:46:48 dist-test-slave-t7g5 krb5kdc[10459](info): set up 2 sockets
Aug 09 00:46:48 dist-test-slave-t7g5 krb5kdc[10459](info): commencing operation
krb5kdc: starting...
W20260809 00:46:50.108191 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:46:50 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:46:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:46:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:46:50.346869 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34197
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:50.684019 10479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:50.684350 10479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:50.684514 10479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:50.692174 10479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:50.692314 10479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:50.692404 10479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:50.692497 10479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:50.692569 10479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:50.702711 10479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:50.704128 10479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:50.705559 10479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:50.717923 10486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:50.718004 10495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:50.717955 10492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:50.718775 10479 server_base.cc:1034] running on GCE node
I20260809 00:46:50.719594 10479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:50.721009 10479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:50.722219 10479 hybrid_clock.cc:648] HybridClock initialized: now 1786236410722171 us; error 35 us; skew 500 ppm
I20260809 00:46:50.722571 10479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:50 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236410, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:50.725708 10479 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:50.727275 10479 webserver.cc:460] Webserver started at http://127.28.92.190:45765/ using document root <none> and password file <none>
I20260809 00:46:50.727981 10479 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:50.728106 10479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:50.728431 10479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:50.731514 10479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "a53e55b103de4f86a389b63a155490ca"
format_stamp: "Formatted at 2026-08-09 00:46:50 on dist-test-slave-t7g5"
server_key: "d5daac06b0a3ee1dbf6d541df050bcb3"
server_key_iv: "d43c23265bfee10e6ec6927963312dc3"
server_key_version: "encryptionkey@0"
I20260809 00:46:50.732297 10479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "a53e55b103de4f86a389b63a155490ca"
format_stamp: "Formatted at 2026-08-09 00:46:50 on dist-test-slave-t7g5"
server_key: "d5daac06b0a3ee1dbf6d541df050bcb3"
server_key_iv: "d43c23265bfee10e6ec6927963312dc3"
server_key_version: "encryptionkey@0"
I20260809 00:46:50.737567 10479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:46:50.740971 10509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:50.742416 10479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 00:46:50.742573 10479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "a53e55b103de4f86a389b63a155490ca"
format_stamp: "Formatted at 2026-08-09 00:46:50 on dist-test-slave-t7g5"
server_key: "d5daac06b0a3ee1dbf6d541df050bcb3"
server_key_iv: "d43c23265bfee10e6ec6927963312dc3"
server_key_version: "encryptionkey@0"
I20260809 00:46:50.742753 10479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:50.754887 10479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:50.758811 10479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:50.759074 10479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:50.776612 10479 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34197
I20260809 00:46:50.776623 10592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34197 every 8 connection(s)
I20260809 00:46:50.778012 10479 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:50.781598 10593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:46:50.787339 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 10479
I20260809 00:46:50.787570 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:46:50.788436 29042 external_mini_cluster.cc:1428] Setting key fff0862c9a89c43795477e37da7a9699
I20260809 00:46:50.792776 10593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Bootstrap starting.
I20260809 00:46:50.796479 10593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Neither blocks nor log segments found. Creating new log.
I20260809 00:46:50.797580 10593 log.cc:824] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:50.800609 10593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: No bootstrap required, opened a new log
Aug 09 00:46:50 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:50.810654 10593 raft_consensus.cc:348] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:50.811203 10593 raft_consensus.cc:374] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:46:50.811332 10593 raft_consensus.cc:729] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a53e55b103de4f86a389b63a155490ca, State: Initialized, Role: FOLLOWER
I20260809 00:46:50.812098 10593 consensus_queue.cc:260] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:50.812440 10593 raft_consensus.cc:388] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:50.812608 10593 raft_consensus.cc:482] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:50.812799 10593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:46:50.813186 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:50.790622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50190 (local address 127.28.92.190:34197)
0809 00:46:50.791404 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:50.791416 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:50.791458 (+ 42us) server_negotiation.cc:407] Connection header received
0809 00:46:50.793164 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:50.793188 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:50.793567 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:50.793940 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:50.795822 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:50.797170 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:50.798774 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:50.799453 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:50.799580 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:50.804135 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:50.804146 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:50.804167 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:50.804216 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:50.808298 (+ 4082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:50.809080 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:50.809090 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:50.809100 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:50.809333 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:50.809827 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:50.809833 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:50.809835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:50.810599 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:50.810895 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:50.811266 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 00:46:50.811761 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":364,"threads_started":1}
I20260809 00:46:50.815366 10593 raft_consensus.cc:504] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:50.815871 10593 leader_election.cc:302] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a53e55b103de4f86a389b63a155490ca; no voters:
I20260809 00:46:50.816422 10593 leader_election.cc:288] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:46:50.816542 10599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:46:50.817188 10599 raft_consensus.cc:686] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 LEADER]: Becoming Leader. State: Replica: a53e55b103de4f86a389b63a155490ca, State: Running, Role: LEADER
I20260809 00:46:50.817764 10599 consensus_queue.cc:237] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:50.818387 10593 sys_catalog.cc:564] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:50.820549 10601 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a53e55b103de4f86a389b63a155490ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } } }
I20260809 00:46:50.820969 10601 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:50.820870 10604 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader a53e55b103de4f86a389b63a155490ca. Latest consensus state: current_term: 1 leader_uuid: "a53e55b103de4f86a389b63a155490ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } } }
I20260809 00:46:50.821175 10604 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:50.824837 10615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:50.830147 10615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:50.839398 10615 catalog_manager.cc:1347] Generated new cluster ID: 07a83eab9bab458cbee97035f34bb4aa
I20260809 00:46:50.839514 10615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:50.854271 10615 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:46:50.855530 10615 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:50.864653 10615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Generated new TSK 0
I20260809 00:46:50.865451 10615 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:46:50.941027 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34197
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:51.284986 10640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:51.285256 10640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:51.285367 10640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:51.292419 10640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:51.292524 10640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:51.292641 10640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:51.302239 10640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:51.303449 10640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:51.304702 10640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:51.317451 10656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:51.317544 10655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:51.317426 10658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:51.318360 10640 server_base.cc:1034] running on GCE node
I20260809 00:46:51.318984 10640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:51.319986 10640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:51.321188 10640 hybrid_clock.cc:648] HybridClock initialized: now 1786236411321133 us; error 43 us; skew 500 ppm
I20260809 00:46:51.321533 10640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:51 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236411, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:51.324846 10640 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:46:51.326316 10640 webserver.cc:460] Webserver started at http://127.28.92.129:39797/ using document root <none> and password file <none>
I20260809 00:46:51.326964 10640 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:51.327064 10640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:51.327342 10640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:51.330216 10640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "d27331a73b354c088086bcb299ef7409"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "aa578bf5afac4b8e07473a59527ec231"
server_key_iv: "59cbe726194ae7b48b6359697d33f27a"
server_key_version: "encryptionkey@0"
I20260809 00:46:51.330945 10640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "d27331a73b354c088086bcb299ef7409"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "aa578bf5afac4b8e07473a59527ec231"
server_key_iv: "59cbe726194ae7b48b6359697d33f27a"
server_key_version: "encryptionkey@0"
I20260809 00:46:51.335886 10640 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:46:51.339145 10669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:51.340366 10640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:51.340495 10640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "d27331a73b354c088086bcb299ef7409"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "aa578bf5afac4b8e07473a59527ec231"
server_key_iv: "59cbe726194ae7b48b6359697d33f27a"
server_key_version: "encryptionkey@0"
I20260809 00:46:51.340651 10640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:51.358831 10640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:51.362453 10640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:51.362689 10640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:51.363579 10640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:51.364914 10640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:51.364986 10640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:51.365077 10640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:51.365118 10640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:51.394928 10640 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40941
I20260809 00:46:51.394968 10870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40941 every 8 connection(s)
I20260809 00:46:51.396226 10640 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:51.400218 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 10640
I20260809 00:46:51.400440 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:46:51.401278 29042 external_mini_cluster.cc:1428] Setting key 807da1df858661a42d6d10737854e81b
Aug 09 00:46:51 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236411, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:51.417969 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:51.398771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:38977 (local address 127.28.92.190:34197)
0809 00:46:51.399217 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:51.399221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:51.400204 (+ 983us) server_negotiation.cc:407] Connection header received
0809 00:46:51.402457 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:51.402462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:51.402525 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:51.402613 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:51.404565 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.405282 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.407340 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.407736 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.407830 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:51.412210 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:51.412217 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:51.412220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:51.412253 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:51.414833 (+ 2580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:51.415596 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:51.415600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:51.415603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:51.415733 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:51.416169 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:51.416172 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:51.416175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:51.416464 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:51.416602 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:51.417323 (+ 721us) server_negotiation.cc:299] Negotiation successful
0809 00:46:51.417570 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":237,"threads_started":1}
I20260809 00:46:51.418905 10879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:51.399186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:38977)
0809 00:46:51.399952 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:51.400009 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:51.402200 (+ 2191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:51.402913 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:51.402924 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:51.403602 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:51.404389 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:51.404414 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.405449 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.405454 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:51.407202 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:51.407217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.407957 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.407964 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:51.408230 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:51.409008 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:51.409044 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:51.411957 (+ 2913us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:51.414983 (+ 3026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:51.414994 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:51.415012 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:51.415452 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:51.415839 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:51.415844 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:51.415848 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:51.416052 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:51.416588 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:51.416596 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:51.416936 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 00:46:51.417185 (+ 249us) client_negotiation.cc:240] Negotiation successful
0809 00:46:51.417738 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":263,"threads_started":1}
I20260809 00:46:51.420449 10871 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34197
I20260809 00:46:51.420725 10871 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:51.421422 10871 heartbeater.cc:511] Master 127.28.92.190:34197 requested a full tablet report, sending...
I20260809 00:46:51.423728 10535 ts_manager.cc:194] Registered new tserver with Master: d27331a73b354c088086bcb299ef7409 (127.28.92.129:40941)
I20260809 00:46:51.425823 10535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:38977
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:46:51.454926 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34197
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:51.775873 10886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:51.776294 10886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:51.776470 10886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:51.785514 10886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:51.785678 10886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:51.785903 10886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:51.796156 10886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:51.797770 10886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:51.799188 10886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:51.811997 10897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:51.812060 10895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:51.812234 10892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:51.812750 10886 server_base.cc:1034] running on GCE node
I20260809 00:46:51.813434 10886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:51.814463 10886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:51.815654 10886 hybrid_clock.cc:648] HybridClock initialized: now 1786236411815597 us; error 53 us; skew 500 ppm
I20260809 00:46:51.815972 10886 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:51 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236411, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:51.819167 10886 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:46:51.820626 10886 webserver.cc:460] Webserver started at http://127.28.92.130:34401/ using document root <none> and password file <none>
I20260809 00:46:51.821342 10886 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:51.821468 10886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:51.821810 10886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:51.824808 10886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "c0799d99b85d400aa853001c3146a8f8"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "a46b99bab5380bad856b1bc8d20702a6"
server_key_iv: "dcedd33a9989c7fc907b7f76ac2f088c"
server_key_version: "encryptionkey@0"
I20260809 00:46:51.825582 10886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "c0799d99b85d400aa853001c3146a8f8"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "a46b99bab5380bad856b1bc8d20702a6"
server_key_iv: "dcedd33a9989c7fc907b7f76ac2f088c"
server_key_version: "encryptionkey@0"
I20260809 00:46:51.830966 10886 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260809 00:46:51.834545 10912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:51.835879 10886 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 00:46:51.836050 10886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "c0799d99b85d400aa853001c3146a8f8"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "a46b99bab5380bad856b1bc8d20702a6"
server_key_iv: "dcedd33a9989c7fc907b7f76ac2f088c"
server_key_version: "encryptionkey@0"
I20260809 00:46:51.836247 10886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:51.859630 10886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:51.863605 10886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:51.863878 10886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:51.864889 10886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:51.866300 10886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:51.866375 10886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:51.866470 10886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:51.866518 10886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:51.896166 10886 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:41661
I20260809 00:46:51.896219 11111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:41661 every 8 connection(s)
I20260809 00:46:51.897440 10886 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:51.904457 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 10886
I20260809 00:46:51.904659 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:46:51.905222 29042 external_mini_cluster.cc:1428] Setting key 8e41b3909f122187af4131e2f82d288c
Aug 09 00:46:51 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236411, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:51.919332 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:51.900043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:51383 (local address 127.28.92.190:34197)
0809 00:46:51.900227 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:51.900232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:51.901408 (+ 1176us) server_negotiation.cc:407] Connection header received
0809 00:46:51.903299 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:51.903306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:51.903392 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:51.903496 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:51.905518 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.906460 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.908541 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.908969 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.909064 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:51.913094 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:51.913099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:51.913103 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:51.913136 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:51.916188 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:51.916930 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:51.916935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:51.916938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:51.917108 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:51.917502 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:51.917507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:51.917510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:51.917878 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:51.918061 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:51.918835 (+ 774us) server_negotiation.cc:299] Negotiation successful
0809 00:46:51.919064 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:46:51.920797 11116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:51.900512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:51383)
0809 00:46:51.901232 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:51.901283 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:51.903015 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:51.903737 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:51.903746 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:51.904487 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:51.905320 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:51.905349 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.906627 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.906631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:51.908374 (+ 1743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:51.908390 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:51.909198 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:51.909205 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:51.909499 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:51.910238 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:51.910266 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:51.912847 (+ 2581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:51.916343 (+ 3496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:51.916351 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:51.916366 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:51.916814 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:51.917202 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:51.917205 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:51.917207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:51.917393 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:51.918069 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:51.918076 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:51.918419 (+ 343us) client_negotiation.cc:769] Sending connection context
0809 00:46:51.918754 (+ 335us) client_negotiation.cc:240] Negotiation successful
0809 00:46:51.919357 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":265,"threads_started":1}
I20260809 00:46:51.922448 11112 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34197
I20260809 00:46:51.922780 11112 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:51.923573 11112 heartbeater.cc:511] Master 127.28.92.190:34197 requested a full tablet report, sending...
I20260809 00:46:51.925143 10535 ts_manager.cc:194] Registered new tserver with Master: c0799d99b85d400aa853001c3146a8f8 (127.28.92.130:41661)
I20260809 00:46:51.926013 10535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:51383
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:46:51.964326 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34197
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:52.292387 11122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:52.292694 11122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:52.292833 11122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:52.300165 11122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:52.300302 11122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:52.300464 11122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:52.310294 11122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:52.311622 11122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:52.312968 11122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:52.325919 11132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:52.325984 11134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:52.326011 11136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:52.326828 11122 server_base.cc:1034] running on GCE node
I20260809 00:46:52.327467 11122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:52.328433 11122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:52.329643 11122 hybrid_clock.cc:648] HybridClock initialized: now 1786236412329587 us; error 40 us; skew 500 ppm
I20260809 00:46:52.330003 11122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:52 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:52.333148 11122 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:46:52.334779 11122 webserver.cc:460] Webserver started at http://127.28.92.131:46323/ using document root <none> and password file <none>
I20260809 00:46:52.335510 11122 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:52.335631 11122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:52.335930 11122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:46:52.338936 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "39e88e50a1634a85b175ea0238ee0194"
format_stamp: "Formatted at 2026-08-09 00:46:52 on dist-test-slave-t7g5"
server_key: "1c301ba7404276b54c162e433367ed70"
server_key_iv: "c9a36b27013ca36a39573b3d2c9506ec"
server_key_version: "encryptionkey@0"
I20260809 00:46:52.339769 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "39e88e50a1634a85b175ea0238ee0194"
format_stamp: "Formatted at 2026-08-09 00:46:52 on dist-test-slave-t7g5"
server_key: "1c301ba7404276b54c162e433367ed70"
server_key_iv: "c9a36b27013ca36a39573b3d2c9506ec"
server_key_version: "encryptionkey@0"
I20260809 00:46:52.345148 11122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:46:52.348767 11149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:52.350152 11122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:46:52.350311 11122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "39e88e50a1634a85b175ea0238ee0194"
format_stamp: "Formatted at 2026-08-09 00:46:52 on dist-test-slave-t7g5"
server_key: "1c301ba7404276b54c162e433367ed70"
server_key_iv: "c9a36b27013ca36a39573b3d2c9506ec"
server_key_version: "encryptionkey@0"
I20260809 00:46:52.350499 11122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:52.362850 11122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:52.366814 11122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:52.367084 11122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:52.367969 11122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:52.369307 11122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:52.369395 11122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:52.369514 11122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:52.369572 11122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:52.400296 11122 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41495
I20260809 00:46:52.400342 11322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41495 every 8 connection(s)
I20260809 00:46:52.401563 11122 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:52.406816 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 11122
I20260809 00:46:52.406996 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:46:52.407451 29042 external_mini_cluster.cc:1428] Setting key 361a318d6a685c9f663c0469194dc75a
Aug 09 00:46:52 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236412, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:46:52.422652 10876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:52.404296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:47081 (local address 127.28.92.190:34197)
0809 00:46:52.404510 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:52.404514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:52.405693 (+ 1179us) server_negotiation.cc:407] Connection header received
0809 00:46:52.407598 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:52.407603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:52.407694 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:52.407805 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:52.409421 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.410538 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.412085 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.412649 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.412784 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:52.416772 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:52.416777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:52.416781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:52.416829 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:52.419549 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.420265 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.420269 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.420271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.420402 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.420764 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.420767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.420769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.421037 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:52.421173 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:52.422058 (+ 885us) server_negotiation.cc:299] Negotiation successful
0809 00:46:52.422290 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 00:46:52.423733 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:52.404770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:47081)
0809 00:46:52.405499 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:52.405536 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:52.407306 (+ 1770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:52.408049 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:52.408057 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:52.408661 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:52.409244 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:52.409263 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.410687 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.410691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:52.411923 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:52.411936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.412900 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.412910 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:52.413218 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:52.413993 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:52.414027 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:52.416543 (+ 2516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:46:52.419693 (+ 3150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:52.419701 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:52.419715 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:52.420167 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:52.420482 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:46:52.420485 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:46:52.420487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:46:52.420685 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:46:52.421172 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:46:52.421182 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:46:52.421598 (+ 416us) client_negotiation.cc:769] Sending connection context
0809 00:46:52.421935 (+ 337us) client_negotiation.cc:240] Negotiation successful
0809 00:46:52.422499 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":298,"threads_started":1}
I20260809 00:46:52.425093 11324 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34197
I20260809 00:46:52.425391 11324 heartbeater.cc:464] Registering TS with master...
I20260809 00:46:52.426215 11324 heartbeater.cc:511] Master 127.28.92.190:34197 requested a full tablet report, sending...
I20260809 00:46:52.427631 10535 ts_manager.cc:194] Registered new tserver with Master: 39e88e50a1634a85b175ea0238ee0194 (127.28.92.131:41495)
I20260809 00:46:52.428431 10535 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:47081
I20260809 00:46:52.428681 10871 heartbeater.cc:503] Master 127.28.92.190:34197 was elected leader, sending a full tablet report...
I20260809 00:46:52.435292 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab.
Entry for principal oryx/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab.
WARNING: no policy specified for oryx/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab.
Entry for principal oryx/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab.
WARNING: no policy specified for oryx/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab.
Entry for principal oryx/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab.
I20260809 00:46:52.602236 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 10640
Aug 09 00:46:52 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:46:52.623598 11339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:52.603482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42040 (local address 127.28.92.129:40941)
0809 00:46:52.608626 (+ 5144us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:52.608634 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:52.608664 (+ 30us) server_negotiation.cc:407] Connection header received
0809 00:46:52.608729 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:52.608736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:52.608954 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:52.609111 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:52.610622 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.611645 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.612888 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.613477 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.613591 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:52.617760 (+ 4169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:52.617773 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:52.617790 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:52.617827 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:52.620745 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.621421 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.621429 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.621431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.621562 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.621961 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.621967 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.621970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.622364 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:52.622669 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:52.622988 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 00:46:52.623248 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4973,"thread_start_us":4824,"threads_started":1}
I20260809 00:46:52.624994 10865 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:52.707332 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 10640
I20260809 00:46:52.738413 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 10886
Aug 09 00:46:52 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:46:52.754494 11342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:52.739290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47288 (local address 127.28.92.130:41661)
0809 00:46:52.739864 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:52.739871 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:52.739897 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:46:52.739960 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:52.739966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:52.740177 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:52.740322 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:52.741644 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.742737 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.744014 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.744582 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.744699 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:52.748875 (+ 4176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:52.748887 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:52.748902 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:52.748949 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:52.751630 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.752272 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.752279 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.752282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.752407 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.752766 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.752770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.752771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.753125 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:52.753464 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:52.753835 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 00:46:52.754113 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":300,"threads_started":1}
I20260809 00:46:52.755815 11105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:52.843503 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 10886
I20260809 00:46:52.866874 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11122
Aug 09 00:46:52 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:46:52.882730 11346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:52.867851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43704 (local address 127.28.92.131:41495)
0809 00:46:52.868390 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:52.868397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:52.868428 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:46:52.868490 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:52.868496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:52.868704 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:52.868865 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:52.870251 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.871286 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.872508 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:52.873040 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:52.873150 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:52.877330 (+ 4180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:52.877342 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:52.877356 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:52.877388 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:52.879868 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.880495 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.880502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.880505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.880631 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:52.880988 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:52.880992 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:52.880994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:52.881342 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:52.881627 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:52.882130 (+ 503us) server_negotiation.cc:299] Negotiation successful
0809 00:46:52.882392 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":249,"threads_started":1}
I20260809 00:46:52.883997 11318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:52.966346 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 11122
I20260809 00:46:52.987867 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 10479
I20260809 00:46:52.989060 10585 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:46:53.091342 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 10479
I20260809 00:46:53.116798 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34197
--webserver_interface=127.28.92.190
--webserver_port=45765
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:46:53.455806 11352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:53.456099 11352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:53.456236 11352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:53.463445 11352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:46:53.463557 11352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:53.463636 11352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:53.463711 11352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:46:53.463770 11352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:46:53.473472 11352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=45765
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:53.474769 11352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:53.476089 11352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:53.487731 11364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:53.487798 11358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:53.487771 11360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:53.488538 11352 server_base.cc:1034] running on GCE node
I20260809 00:46:53.489254 11352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:53.490634 11352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:53.491839 11352 hybrid_clock.cc:648] HybridClock initialized: now 1786236413491786 us; error 39 us; skew 500 ppm
I20260809 00:46:53.492168 11352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:53 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236413, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:53.495131 11352 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:46:53.496531 11352 webserver.cc:460] Webserver started at http://127.28.92.190:45765/ using document root <none> and password file <none>
I20260809 00:46:53.497195 11352 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:53.497326 11352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:53.502642 11352 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 00:46:53.505353 11375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:53.506620 11352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:46:53.506784 11352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "a53e55b103de4f86a389b63a155490ca"
format_stamp: "Formatted at 2026-08-09 00:46:50 on dist-test-slave-t7g5"
server_key: "d5daac06b0a3ee1dbf6d541df050bcb3"
server_key_iv: "d43c23265bfee10e6ec6927963312dc3"
server_key_version: "encryptionkey@0"
I20260809 00:46:53.507709 11352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:53.543893 11352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:53.547976 11352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:53.548235 11352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:53.566197 11352 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34197
I20260809 00:46:53.566220 11454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34197 every 8 connection(s)
I20260809 00:46:53.567744 11352 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:46:53.570732 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 11352
I20260809 00:46:53.571723 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:40941
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:34197
--webserver_port=39797
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:46:53.576390 11455 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:46:53.580749 11455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Bootstrap starting.
I20260809 00:46:53.599736 11455 log.cc:824] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Log is configured to *not* fsync() on all Append() calls
I20260809 00:46:53.609163 11455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:46:53.609694 11455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Bootstrap complete.
I20260809 00:46:53.618886 11455 raft_consensus.cc:348] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:53.619738 11455 raft_consensus.cc:729] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a53e55b103de4f86a389b63a155490ca, State: Initialized, Role: FOLLOWER
I20260809 00:46:53.620349 11455 consensus_queue.cc:260] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:53.620599 11455 raft_consensus.cc:388] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:46:53.620718 11455 raft_consensus.cc:482] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:46:53.620880 11455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 1 FOLLOWER]: Advancing to term 2
I20260809 00:46:53.624732 11455 raft_consensus.cc:504] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:53.625212 11455 leader_election.cc:302] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a53e55b103de4f86a389b63a155490ca; no voters:
I20260809 00:46:53.625875 11455 leader_election.cc:288] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 00:46:53.626044 11466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 2 FOLLOWER]: Leader election won for term 2
I20260809 00:46:53.627158 11466 raft_consensus.cc:686] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [term 2 LEADER]: Becoming Leader. State: Replica: a53e55b103de4f86a389b63a155490ca, State: Running, Role: LEADER
I20260809 00:46:53.627735 11466 consensus_queue.cc:237] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } }
I20260809 00:46:53.628119 11455 sys_catalog.cc:564] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:46:53.630228 11469 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader a53e55b103de4f86a389b63a155490ca. Latest consensus state: current_term: 2 leader_uuid: "a53e55b103de4f86a389b63a155490ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } } }
I20260809 00:46:53.630893 11469 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:53.630517 11467 sys_catalog.cc:455] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a53e55b103de4f86a389b63a155490ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a53e55b103de4f86a389b63a155490ca" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34197 } } }
I20260809 00:46:53.631524 11467 sys_catalog.cc:458] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca [sys.catalog]: This master's current role is: LEADER
I20260809 00:46:53.635771 11479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:46:53.642190 11479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:46:53.643596 11479 catalog_manager.cc:1259] Loaded cluster ID: 07a83eab9bab458cbee97035f34bb4aa
I20260809 00:46:53.643697 11479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:46:53.647609 11479 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:46:53.649024 11479 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a53e55b103de4f86a389b63a155490ca: Loaded TSK: 0
I20260809 00:46:53.650663 11479 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 00:46:53.913584 11463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:53.913915 11463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:53.914059 11463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:53.921238 11463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:53.921363 11463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:53.921525 11463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:46:53.931389 11463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.129.keytab
--principal=oryx/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:40941
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=39797
--tserver_master_addrs=127.28.92.190:34197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:53.932687 11463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:53.934082 11463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:53.948375 11508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:53.948405 11506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:53.949012 11505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:53.949975 11463 server_base.cc:1034] running on GCE node
I20260809 00:46:53.950712 11463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:53.951809 11463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:53.953058 11463 hybrid_clock.cc:648] HybridClock initialized: now 1786236413952996 us; error 46 us; skew 500 ppm
I20260809 00:46:53.953433 11463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:53 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236413, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:53.961988 11463 init.cc:377] Logged in from keytab as oryx/127.28.92.129@KRBTEST.COM (short username oryx)
I20260809 00:46:53.963716 11463 webserver.cc:460] Webserver started at http://127.28.92.129:39797/ using document root <none> and password file <none>
I20260809 00:46:53.964598 11463 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:53.964757 11463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:53.971477 11463 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 00:46:53.975080 11519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:53.976799 11463 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 00:46:53.976984 11463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "d27331a73b354c088086bcb299ef7409"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "aa578bf5afac4b8e07473a59527ec231"
server_key_iv: "59cbe726194ae7b48b6359697d33f27a"
server_key_version: "encryptionkey@0"
I20260809 00:46:53.978302 11463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:53.993500 11463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:53.997299 11463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:53.997520 11463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:53.998579 11463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:53.999868 11463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:53.999955 11463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:54.000038 11463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:54.000092 11463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:54.031121 11463 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40941
I20260809 00:46:54.031181 11711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40941 every 8 connection(s)
I20260809 00:46:54.032558 11463 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:46:54.039311 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 11463
I20260809 00:46:54.040138 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:41661
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:34197
--webserver_port=34401
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:46:54 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:54 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 00:46:54.381464 11721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:54.381781 11721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:54.381927 11721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:54.388989 11721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:54.389110 11721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:54.389271 11721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:46:54.398667 11721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.130.keytab
--principal=oryx/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:41661
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=34401
--tserver_master_addrs=127.28.92.190:34197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:54.399914 11721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:54.401190 11721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:54.416364 11733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:54.416778 11735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:54.417210 11721 server_base.cc:1034] running on GCE node
W20260809 00:46:54.417634 11732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:54.418365 11721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:54.419484 11721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:54.420912 11721 hybrid_clock.cc:648] HybridClock initialized: now 1786236414420839 us; error 56 us; skew 500 ppm
I20260809 00:46:54.421334 11721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:54 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236414, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:54.424921 11721 init.cc:377] Logged in from keytab as oryx/127.28.92.130@KRBTEST.COM (short username oryx)
I20260809 00:46:54.426509 11721 webserver.cc:460] Webserver started at http://127.28.92.130:34401/ using document root <none> and password file <none>
I20260809 00:46:54.427188 11721 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:54.427322 11721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:54.432767 11721 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:46:54.435699 11745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:54.437283 11721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:46:54.437449 11721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "c0799d99b85d400aa853001c3146a8f8"
format_stamp: "Formatted at 2026-08-09 00:46:51 on dist-test-slave-t7g5"
server_key: "a46b99bab5380bad856b1bc8d20702a6"
server_key_iv: "dcedd33a9989c7fc907b7f76ac2f088c"
server_key_version: "encryptionkey@0"
I20260809 00:46:54.438450 11721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:54.510083 11721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:54.514604 11721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:54.514881 11721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:54.516004 11721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:54.517455 11721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:54.517557 11721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:54.517688 11721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:54.517772 11721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 00:46:54.559393 11721 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:41661
I20260809 00:46:54.559458 11939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:41661 every 8 connection(s)
I20260809 00:46:54.560931 11721 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:46:54.562501 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 11721
I20260809 00:46:54.563093 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:41495
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:34197
--webserver_port=46323
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:41941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:46:54 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:54 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 00:46:55.052901 11717 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.006s user 0.000s sys 0.015s
I20260809 00:46:55.055033 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:54.035798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:56761)
0809 00:46:54.036634 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:54.036693 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:54.038433 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:54.040102 (+ 1669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:54.040113 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:54.041019 (+ 906us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:54.041560 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:54.041578 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.043684 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.043688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:54.044932 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:54.044945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.046379 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.046385 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:54.046582 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:54.047220 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:54.047250 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:55.053836 (+1006586us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":364,"threads_started":1}
W20260809 00:46:55.055076 11716 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:54.035764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:56761 (local address 127.28.92.190:34197)
0809 00:46:54.036516 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:54.036530 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:54.036802 (+ 272us) server_negotiation.cc:407] Connection header received
0809 00:46:54.039074 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:54.039093 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:54.039567 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:54.039979 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:54.041790 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.043507 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.045080 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.046140 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.046330 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.054296 (+1007966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:56761: BlockingRecv error: recv got EOF from 127.28.92.129:56761 (error 108)
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":241,"threads_started":1}
W20260809 00:46:55.056413 11713 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:34197 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.92.190:34197: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:55.065766 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:55.057129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:35761)
0809 00:46:55.057621 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:55.057639 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:55.057778 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:55.058094 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:55.058098 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:55.058484 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:55.058642 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.058652 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.059646 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.059650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.060583 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.060595 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.061282 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.061289 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.061446 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.062029 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:55.062047 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:55.065440 (+ 3393us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":79}
W20260809 00:46:55.065898 11716 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:55.057445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:35761 (local address 127.28.92.190:34197)
0809 00:46:55.057614 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:55.057621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:55.057708 (+ 87us) server_negotiation.cc:407] Connection header received
0809 00:46:55.057900 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:55.057904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:55.057967 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:55.058051 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:55.058788 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.059505 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.060719 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.061114 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.061222 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.065643 (+ 4421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:35761: BlockingRecv error: recv got EOF from 127.28.92.129:35761 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:55.074741 11717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:55.066686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:51247)
0809 00:46:55.067069 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:55.067083 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:55.067180 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:55.067470 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:55.067474 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:55.067795 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:55.067942 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.067958 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.068926 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.068932 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.069947 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.069959 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.070620 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.070626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.070814 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.071369 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:55.071386 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:55.074486 (+ 3100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190}
W20260809 00:46:55.074932 11716 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:55.066816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:51247 (local address 127.28.92.190:34197)
0809 00:46:55.066962 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:55.066967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:55.067144 (+ 177us) server_negotiation.cc:407] Connection header received
0809 00:46:55.067272 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:55.067277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:55.067355 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:55.067432 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:55.068082 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.068785 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.070077 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.070475 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.070582 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.074706 (+ 4124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:51247: BlockingRecv error: recv got EOF from 127.28.92.129:51247 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260809 00:46:55.075343 11713 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 00:46:55.108139 11946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:46:55.108649 11946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:46:55.108820 11946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:46:55.121896 11946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:46:55.122082 11946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:46:55.122309 11946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:46:55.140215 11946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/krb5kdc/oryx_127.28.92.131.keytab
--principal=oryx/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:41495
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=46323
--tserver_master_addrs=127.28.92.190:34197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:46:55.142447 11946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:46:55.144446 11946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:46:55.160339 11956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:55.160880 11958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:46:55.161224 11963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:46:55.162334 11946 server_base.cc:1034] running on GCE node
I20260809 00:46:55.163156 11946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:46:55.164435 11946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:46:55.165709 11946 hybrid_clock.cc:648] HybridClock initialized: now 1786236415165591 us; error 76 us; skew 500 ppm
I20260809 00:46:55.166124 11946 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236415, etypes {rep=17 tkt=17 ses=17}, oryx/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:46:55.170575 11946 init.cc:377] Logged in from keytab as oryx/127.28.92.131@KRBTEST.COM (short username oryx)
I20260809 00:46:55.172626 11946 webserver.cc:460] Webserver started at http://127.28.92.131:46323/ using document root <none> and password file <none>
I20260809 00:46:55.173733 11946 fs_manager.cc:359] Metadata directory not provided
I20260809 00:46:55.173908 11946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:46:55.182464 11946 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:46:55.186635 11975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:55.188572 11946 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260809 00:46:55.188805 11946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "39e88e50a1634a85b175ea0238ee0194"
format_stamp: "Formatted at 2026-08-09 00:46:52 on dist-test-slave-t7g5"
server_key: "1c301ba7404276b54c162e433367ed70"
server_key_iv: "c9a36b27013ca36a39573b3d2c9506ec"
server_key_version: "encryptionkey@0"
I20260809 00:46:55.190455 11946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:46:55.232319 11946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:46:55.238910 11946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:46:55.239327 11946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:46:55.240803 11946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:46:55.242959 11946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:46:55.243116 11946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:55.243242 11946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:46:55.243340 11946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:46:55.276651 11946 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41495
I20260809 00:46:55.276672 12157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41495 every 8 connection(s)
I20260809 00:46:55.278756 11946 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:46:55.280560 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 11946
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:55.301127 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:55.281615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.28.92.190:34197)
0809 00:46:55.281863 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:55.281870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:55.283090 (+ 1220us) server_negotiation.cc:407] Connection header received
0809 00:46:55.283286 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:55.283292 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:55.283396 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:55.283509 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:55.285544 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.286638 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.288665 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.289285 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.289419 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.293106 (+ 3687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:46:55.293116 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:46:55.293134 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:46:55.293182 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:46:55.296328 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:55.298445 (+ 2117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:55.298457 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:55.298467 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:55.298714 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:46:55.299112 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:46:55.299117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:46:55.299119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:46:55.299608 (+ 489us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:46:55.299901 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 00:46:55.300392 (+ 491us) server_negotiation.cc:299] Negotiation successful
0809 00:46:55.300866 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260809 00:46:55.696171 11944 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.105s user 0.006s sys 0.011s
W20260809 00:46:55.698081 11945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:54.569708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:51943 (local address 127.28.92.190:34197)
0809 00:46:54.582113 (+ 12405us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:54.582119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:54.582145 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:46:54.582219 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:54.582224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:54.582327 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:54.582454 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:54.585257 (+ 2803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.586479 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.589118 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.589787 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.589935 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.697693 (+1107758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:51943: BlockingRecv error: recv got EOF from 127.28.92.130:51943 (error 108)
Metrics: {"server-negotiator.queue_time_us":12233,"thread_start_us":12109,"threads_started":1}
I20260809 00:46:55.699015 11944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:54.568873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:51943)
0809 00:46:54.575085 (+ 6212us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:54.575146 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:54.577587 (+ 2441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:54.582985 (+ 5398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:54.583001 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:54.583991 (+ 990us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:54.584998 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:54.585027 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.586672 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.586678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:54.588928 (+ 2250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:54.588947 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:54.590063 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:54.590071 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:54.590415 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:54.591325 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:54.591360 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:55.697458 (+1106098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":5860,"thread_start_us":5584,"threads_started":1}
W20260809 00:46:55.700007 11940 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:34197 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.92.190:34197: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:55.709524 11944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:55.700691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:37309)
0809 00:46:55.700875 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:55.700896 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:55.701011 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:55.701328 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:55.701332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:55.701750 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:55.701922 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.701931 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.702947 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.702951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.703930 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.703941 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.704637 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.704644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.704791 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.705510 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:55.705527 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:55.709222 (+ 3695us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260809 00:46:55.709717 11945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:55.700801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:37309 (local address 127.28.92.190:34197)
0809 00:46:55.700998 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:55.701005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:55.701023 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:46:55.701129 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:55.701134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:55.701202 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:55.701277 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:55.702058 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.702800 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.704063 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.704472 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.704581 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.709458 (+ 4877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:37309: BlockingRecv error: recv got EOF from 127.28.92.130:37309 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:55 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:55.720888 11944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:55.710485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:48011)
0809 00:46:55.711250 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:55.711275 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:55.711419 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:55.711908 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:55.711913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:55.712218 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:55.712380 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.712388 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.714159 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.714163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.715104 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.715115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.716200 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.716205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.716360 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.717010 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:55.717026 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:55.720659 (+ 3633us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":1179,"threads_started":1}
W20260809 00:46:55.721306 11940 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 00:46:55.721386 11945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:55.710682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:48011 (local address 127.28.92.190:34197)
0809 00:46:55.710891 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:55.710897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:55.711347 (+ 450us) server_negotiation.cc:407] Connection header received
0809 00:46:55.711557 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:55.711563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:55.711667 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:55.711758 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:55.712576 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.713989 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.715243 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.716035 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.716188 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.721020 (+ 4832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:48011: BlockingRecv error: recv got EOF from 127.28.92.130:48011 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 00:46:56.087770 11945 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:56.076352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:43251 (local address 127.28.92.190:34197)
0809 00:46:56.076583 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:56.076591 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:56.076961 (+ 370us) server_negotiation.cc:407] Connection header received
0809 00:46:56.077165 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:56.077171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:56.077282 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:56.077400 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:56.078544 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.079787 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.081298 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.081953 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.082073 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.087579 (+ 5506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:43251: BlockingRecv error: recv got EOF from 127.28.92.129:43251 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:46:56.087757 12170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:56.076177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:43251)
0809 00:46:56.076862 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:56.076883 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:56.077002 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:56.077531 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:56.077536 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:56.078196 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:56.078380 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.078391 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.079936 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.079939 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.081138 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.081155 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.082114 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.082120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.082287 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.083008 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:56.083026 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:56.087348 (+ 4322us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":419,"threads_started":1}
W20260809 00:46:56.300029 12166 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.005s user 0.004s sys 0.016s
W20260809 00:46:56.301172 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:55.283488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:38225 (local address 127.28.92.190:34197)
0809 00:46:55.284081 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:55.284086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:55.288429 (+ 4343us) server_negotiation.cc:407] Connection header received
0809 00:46:55.288475 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:55.288478 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:55.288535 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:55.288624 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:55.290708 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.291464 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.293026 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.293705 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.293828 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.300945 (+1007117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:38225: BlockingRecv error: recv got EOF from 127.28.92.131:38225 (error 108)
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":290,"threads_started":1}
I20260809 00:46:56.301642 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:55.283682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:38225)
0809 00:46:55.286442 (+ 2760us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:55.286489 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:55.288174 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:55.289168 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:55.289180 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:55.289865 (+ 685us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:55.290528 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.290548 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.291633 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.291636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.292838 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:55.292850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:55.293963 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:55.293971 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:55.294311 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:55.294983 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:55.295033 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:56.300744 (+1005711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":2065,"thread_start_us":1827,"threads_started":1}
W20260809 00:46:56.302542 12158 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:34197 (0 consecutive failures): Not authorized: Failed to ping master at 127.28.92.190:34197: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:56.311961 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:56.303163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:49869)
0809 00:46:56.303375 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:56.303398 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:56.303523 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:56.303857 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:56.303860 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:56.304213 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:56.304383 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.304392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.305482 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.305485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.306452 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.306464 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.307112 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.307116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.307226 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.307771 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:56.307787 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:56.311674 (+ 3887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 00:46:56.312134 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:56.303358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:49869 (local address 127.28.92.190:34197)
0809 00:46:56.303607 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:56.303611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:56.303626 (+ 15us) server_negotiation.cc:407] Connection header received
0809 00:46:56.303671 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:56.303674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:56.303731 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:56.303828 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:56.304534 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.305368 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.306574 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.306984 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.307075 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.311901 (+ 4826us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:49869: BlockingRecv error: recv got EOF from 127.28.92.131:49869 (error 108)
Metrics: {"server-negotiator.queue_time_us":148}
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:56.320406 12166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:56.312687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:37361)
0809 00:46:56.312842 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:56.312857 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:56.312939 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:56.313176 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:56.313179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:56.313480 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:56.313632 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.313640 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.314653 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.314657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.315605 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.315617 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.316331 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.316337 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.316510 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.317060 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:56.317078 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:56.320143 (+ 3065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 00:46:56.320621 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:56.312751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:37361 (local address 127.28.92.190:34197)
0809 00:46:56.312903 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:56.312908 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:56.312923 (+ 15us) server_negotiation.cc:407] Connection header received
0809 00:46:56.313021 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:56.313025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:56.313080 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:56.313151 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:56.313796 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.314516 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.315736 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.316188 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.316296 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.320354 (+ 4058us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:37361: BlockingRecv error: recv got EOF from 127.28.92.131:37361 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 00:46:56.320782 12158 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:56 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:56.730844 12172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:56.721918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:36875)
0809 00:46:56.722519 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:56.722536 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:56.722655 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:56.722952 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:56.722955 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:56.723389 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:56.723554 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.723562 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.724606 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.724610 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.725559 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:56.725572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.726233 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.726238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:56.726362 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.726905 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:56.726923 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:56.730611 (+ 3688us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":350,"threads_started":1}
W20260809 00:46:56.731009 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:56.722043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:36875 (local address 127.28.92.190:34197)
0809 00:46:56.722225 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:56.722230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:56.722622 (+ 392us) server_negotiation.cc:407] Connection header received
0809 00:46:56.722771 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:56.722775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:56.722839 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:56.722923 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:56.723696 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.724477 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.725691 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:56.726087 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:56.726179 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:56.730823 (+ 4644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:36875: BlockingRecv error: recv got EOF from 127.28.92.130:36875 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 00:46:57 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:57 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:57.097571 12174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:57.089151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:37287)
0809 00:46:57.089648 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:57.089694 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:57.089844 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:57.090202 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:57.090205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:57.090590 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:57.090775 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:57.090784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.091749 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.091752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:57.092666 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:57.092676 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.093317 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.093321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:57.093441 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:57.094029 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:57.094047 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:57.097291 (+ 3244us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":278,"threads_started":1}
W20260809 00:46:57.097769 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:57.089249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:37287 (local address 127.28.92.190:34197)
0809 00:46:57.089473 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:57.089480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:57.089779 (+ 299us) server_negotiation.cc:407] Connection header received
0809 00:46:57.089987 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:57.089991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:57.090063 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:57.090140 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:57.090885 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.091637 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.092767 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.093205 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.093291 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:57.097484 (+ 4193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:37287: BlockingRecv error: recv got EOF from 127.28.92.129:37287 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 00:46:57 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:57 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:57.331173 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:57.321456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:43815)
0809 00:46:57.322064 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:57.322079 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:57.322212 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:57.322534 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:57.322539 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:57.322982 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:57.323137 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:57.323146 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.324165 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.324169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:57.325147 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:57.325159 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.326078 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.326084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:57.326236 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:57.326859 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:57.326885 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:57.330857 (+ 3972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":373,"threads_started":1}
W20260809 00:46:57.331305 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:57.321541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:43815 (local address 127.28.92.190:34197)
0809 00:46:57.321750 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:57.321757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:57.322168 (+ 411us) server_negotiation.cc:407] Connection header received
0809 00:46:57.322329 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:57.322335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:57.322408 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:57.322490 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:57.323290 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.324027 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.325291 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.325901 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.326018 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:57.331093 (+ 5075us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:43815: BlockingRecv error: recv got EOF from 127.28.92.131:43815 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 00:46:57 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:57 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:57.740435 12182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:57.731736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:51155)
0809 00:46:57.732220 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:57.732236 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:57.732389 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:57.732704 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:57.732709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:57.733141 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:57.733330 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:57.733340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.734401 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.734407 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:57.735324 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:57.735336 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.736108 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.736114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:57.736283 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:57.736898 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:57.736935 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:57.740175 (+ 3240us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":262,"threads_started":1}
W20260809 00:46:57.740615 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:57.731828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:51155 (local address 127.28.92.190:34197)
0809 00:46:57.732026 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:57.732031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:57.732325 (+ 294us) server_negotiation.cc:407] Connection header received
0809 00:46:57.732509 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:57.732515 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:57.732577 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:57.732653 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:57.733469 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.734263 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.735489 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:57.735943 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:57.736058 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:57.740384 (+ 4326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:51155: BlockingRecv error: recv got EOF from 127.28.92.130:51155 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 00:46:58 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:58 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:58.106808 12183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:58.098484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:39295)
0809 00:46:58.098989 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:58.099009 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:58.099122 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:58.099379 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:58.099382 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:58.099746 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:58.099917 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:58.099925 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.100977 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.100983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:58.102130 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:58.102144 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.102775 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.102779 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:58.102898 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:58.103425 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:58.103442 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:58.106581 (+ 3139us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":239,"threads_started":1}
W20260809 00:46:58.106951 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:58.098633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:39295 (local address 127.28.92.190:34197)
0809 00:46:58.098859 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:58.098866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:58.099073 (+ 207us) server_negotiation.cc:407] Connection header received
0809 00:46:58.099209 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:58.099212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:58.099274 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:58.099348 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:58.100038 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.100820 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.102248 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.102668 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.102761 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:58.106757 (+ 3996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:39295: BlockingRecv error: recv got EOF from 127.28.92.129:39295 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 09 00:46:58 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:58 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:58.341092 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:58.332155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:36435)
0809 00:46:58.332807 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:58.332824 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:58.332935 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:58.333276 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:58.333281 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:58.333773 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:58.333970 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:58.333981 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.335041 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.335046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:58.336011 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:58.336024 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.336731 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.336737 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:58.336924 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:58.337449 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:58.337466 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:58.340756 (+ 3290us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":438,"threads_started":1}
W20260809 00:46:58.341197 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:58.332212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:36435 (local address 127.28.92.190:34197)
0809 00:46:58.332427 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:58.332435 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:58.332897 (+ 462us) server_negotiation.cc:407] Connection header received
0809 00:46:58.333072 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:58.333076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:58.333138 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:58.333218 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:58.334110 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.334899 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.336162 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.336583 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.336690 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:58.340953 (+ 4263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:36435: BlockingRecv error: recv got EOF from 127.28.92.131:36435 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 09 00:46:58 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:58 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:58.750427 12187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:58.741396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:58761)
0809 00:46:58.741892 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:58.741908 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:58.742109 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:58.742499 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:58.742504 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:58.742865 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:58.743041 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:58.743053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.744245 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.744250 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:58.745327 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:58.745341 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.746076 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.746082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:58.746248 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:58.746851 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:58.746869 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:58.750179 (+ 3310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":259,"threads_started":1}
W20260809 00:46:58.750624 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:58.741485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:58761 (local address 127.28.92.190:34197)
0809 00:46:58.741733 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:58.741739 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:58.742037 (+ 298us) server_negotiation.cc:407] Connection header received
0809 00:46:58.742264 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:58.742270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:58.742337 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:58.742423 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:58.743199 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.744102 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.745466 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:58.745922 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:58.746038 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:58.750396 (+ 4358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:58761: BlockingRecv error: recv got EOF from 127.28.92.130:58761 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 09 00:46:59 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:59 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:59.121075 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:59.107756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:36117)
0809 00:46:59.108324 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:59.108344 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:59.108485 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:59.108803 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:59.108807 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:59.109213 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:59.109380 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:59.109389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.110432 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.110436 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:59.111484 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:59.111497 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.112209 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.112214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:59.112384 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:59.116918 (+ 4534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:59.116936 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:59.120722 (+ 3786us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":357,"threads_started":1}
W20260809 00:46:59.121206 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:59.107803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:36117 (local address 127.28.92.190:34197)
0809 00:46:59.107982 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:59.107989 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:59.108433 (+ 444us) server_negotiation.cc:407] Connection header received
0809 00:46:59.108606 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:59.108611 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:59.108676 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:59.108756 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:59.109529 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.110297 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.111619 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.112072 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.112182 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:59.120962 (+ 8780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:36117: BlockingRecv error: recv got EOF from 127.28.92.129:36117 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 09 00:46:59 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:59 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:59.350999 12190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:59.342116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:41575)
0809 00:46:59.342668 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:59.342684 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:59.342813 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:59.343129 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:59.343133 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:59.343542 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:59.343760 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:59.343776 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.344902 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.344908 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:59.345935 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:59.345956 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.346641 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.346646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:59.346822 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:59.347367 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:59.347384 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:59.350681 (+ 3297us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":263,"threads_started":1}
W20260809 00:46:59.351109 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:59.342194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:41575 (local address 127.28.92.190:34197)
0809 00:46:59.342401 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:59.342407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:59.342768 (+ 361us) server_negotiation.cc:407] Connection header received
0809 00:46:59.342930 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:59.342935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:59.342998 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:59.343078 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:59.343910 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.344769 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.346079 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.346505 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.346614 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:59.350893 (+ 4279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:41575: BlockingRecv error: recv got EOF from 127.28.92.131:41575 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 00:46:59 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:46:59 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:46:59.760048 12193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:46:59.751314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:60287)
0809 00:46:59.751835 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 00:46:59.751851 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:46:59.751972 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:46:59.752242 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:46:59.752245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:46:59.752632 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:46:59.752802 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:59.752811 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.753821 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.753825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:59.754838 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:46:59.754850 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.755539 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.755543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:46:59.755661 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:59.756203 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:46:59.756219 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:46:59.759792 (+ 3573us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":296,"threads_started":1}
W20260809 00:46:59.760222 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:46:59.751393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:60287 (local address 127.28.92.190:34197)
0809 00:46:59.751564 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 00:46:59.751568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:46:59.751916 (+ 348us) server_negotiation.cc:407] Connection header received
0809 00:46:59.752068 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:46:59.752072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:46:59.752131 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:46:59.752209 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:46:59.752907 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.753710 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.754969 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:46:59.755416 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:46:59.755529 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:46:59.759991 (+ 4462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:60287: BlockingRecv error: recv got EOF from 127.28.92.130:60287 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 00:47:00 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:00 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:00.130844 12194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:00.122205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:54965)
0809 00:47:00.122721 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:00.122743 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:00.122858 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:00.123121 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:00.123124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:00.123536 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:00.123693 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:00.123703 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.124726 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.124729 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:00.125716 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:00.125729 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.126396 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.126400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:00.126528 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:00.127067 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:00.127084 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:00.130610 (+ 3526us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":277,"threads_started":1}
W20260809 00:47:00.131035 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:00.122293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54965 (local address 127.28.92.190:34197)
0809 00:47:00.122470 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:00.122475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:00.122810 (+ 335us) server_negotiation.cc:407] Connection header received
0809 00:47:00.122948 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:00.122952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:00.123013 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:00.123090 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:00.123860 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.124622 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.125856 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.126278 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.126386 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:00.130824 (+ 4438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:54965: BlockingRecv error: recv got EOF from 127.28.92.129:54965 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 00:47:00 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:00 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:00.360998 12195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:00.351985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:51349)
0809 00:47:00.352545 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:00.352560 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:00.352707 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:00.353051 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:00.353056 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:00.353463 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:00.353631 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:00.353640 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.354668 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.354673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:00.355925 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:00.355937 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.356616 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.356621 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:00.356783 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:00.357327 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:00.357345 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:00.360745 (+ 3400us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":306,"threads_started":1}
W20260809 00:47:00.361186 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:00.352094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:51349 (local address 127.28.92.190:34197)
0809 00:47:00.352286 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:00.352293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:00.352652 (+ 359us) server_negotiation.cc:407] Connection header received
0809 00:47:00.352844 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:00.352848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:00.352912 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:00.352993 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:00.353794 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.354538 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.356052 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.356480 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.356588 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:00.360958 (+ 4370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:51349: BlockingRecv error: recv got EOF from 127.28.92.131:51349 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 09 00:47:00 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:00 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:00.770046 12197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:00.760897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:54001)
0809 00:47:00.761400 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:00.761417 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:00.761551 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:00.761911 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:00.761916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:00.762351 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:00.762508 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:00.762517 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.763504 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.763510 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:00.764456 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:00.764468 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.765143 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.765149 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:00.765326 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:00.765986 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:00.766005 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:00.769774 (+ 3769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":252,"threads_started":1}
W20260809 00:47:00.770283 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:00.761109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:54001 (local address 127.28.92.190:34197)
0809 00:47:00.761337 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:00.761343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:00.761493 (+ 150us) server_negotiation.cc:407] Connection header received
0809 00:47:00.761698 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:00.761702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:00.761773 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:00.761859 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:00.762656 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.763377 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.764595 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:00.765004 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:00.765114 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:00.770018 (+ 4904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:54001: BlockingRecv error: recv got EOF from 127.28.92.130:54001 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 00:47:01 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:01 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:01.140609 12198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:01.131920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:43801)
0809 00:47:01.132440 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:01.132471 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:01.132587 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:01.132862 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:01.132866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:01.133274 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:01.133468 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:01.133478 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.134437 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.134440 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:01.135349 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:01.135360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.136151 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.136156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:01.136286 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:01.136942 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:01.136965 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:01.140360 (+ 3395us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":246,"threads_started":1}
W20260809 00:47:01.140766 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:01.132005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:43801 (local address 127.28.92.190:34197)
0809 00:47:01.132188 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:01.132193 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:01.132537 (+ 344us) server_negotiation.cc:407] Connection header received
0809 00:47:01.132683 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:01.132687 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:01.132749 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:01.132831 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:01.133584 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.134337 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.135484 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.135991 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.136086 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:01.140542 (+ 4456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:43801: BlockingRecv error: recv got EOF from 127.28.92.129:43801 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 00:47:01 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:01 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:01.370613 12199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:01.361939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:54377)
0809 00:47:01.362604 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:01.362621 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:01.362749 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:01.363058 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:01.363063 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:01.363497 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:01.363656 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:01.363665 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.364694 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.364700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:01.365634 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:01.365647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.366349 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.366355 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:01.366528 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:01.367039 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:01.367055 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:01.370368 (+ 3313us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":427,"threads_started":1}
W20260809 00:47:01.370771 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:01.362034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:54377 (local address 127.28.92.190:34197)
0809 00:47:01.362228 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:01.362235 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:01.362702 (+ 467us) server_negotiation.cc:407] Connection header received
0809 00:47:01.362869 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:01.362873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:01.362933 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:01.363012 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:01.363793 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.364554 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.365787 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.366211 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.366320 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:01.370573 (+ 4253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:54377: BlockingRecv error: recv got EOF from 127.28.92.131:54377 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 00:47:01 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:01 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:01.779640 12200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:01.771089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:49513)
0809 00:47:01.771581 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:01.771598 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:01.771726 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:01.772003 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:01.772006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:01.772460 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:01.772673 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:01.772685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.773766 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.773771 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:01.774715 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:01.774728 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.775413 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.775419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:01.775607 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:01.776132 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:01.776149 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:01.779410 (+ 3261us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":272,"threads_started":1}
W20260809 00:47:01.779839 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:01.771163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:49513 (local address 127.28.92.190:34197)
0809 00:47:01.771347 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:01.771352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:01.771662 (+ 310us) server_negotiation.cc:407] Connection header received
0809 00:47:01.771824 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:01.771828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:01.771888 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:01.771989 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:01.772872 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.773593 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.774854 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:01.775265 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:01.775373 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:01.779606 (+ 4233us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:49513: BlockingRecv error: recv got EOF from 127.28.92.130:49513 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 09 00:47:02 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:02 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:02.150257 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:02.141493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:39529)
0809 00:47:02.142077 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:02.142099 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:02.142223 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:02.142504 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:02.142507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:02.142994 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:02.143179 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:02.143188 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.144112 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.144115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:02.145055 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:02.145067 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.145689 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.145693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:02.145807 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:02.146346 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:02.146362 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:02.150025 (+ 3663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":261,"threads_started":1}
W20260809 00:47:02.150398 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:02.141531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:39529 (local address 127.28.92.190:34197)
0809 00:47:02.141765 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:02.141773 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:02.142173 (+ 400us) server_negotiation.cc:407] Connection header received
0809 00:47:02.142319 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:02.142323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:02.142386 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:02.142463 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:02.143300 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.144004 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.145159 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.145558 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.145644 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:02.150204 (+ 4560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:39529: BlockingRecv error: recv got EOF from 127.28.92.129:39529 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 00:47:02 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:02 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:02.380152 12207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:02.371476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:42837)
0809 00:47:02.371948 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:02.371964 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:02.372078 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:02.372347 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:02.372350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:02.372762 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:02.372925 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:02.372933 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.373939 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.373942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:02.374860 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:02.374871 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.375573 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.375578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:02.375738 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:02.376395 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:02.376417 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:02.379826 (+ 3409us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":248,"threads_started":1}
W20260809 00:47:02.380300 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:02.371555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:42837 (local address 127.28.92.190:34197)
0809 00:47:02.371711 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:02.371716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:02.372028 (+ 312us) server_negotiation.cc:407] Connection header received
0809 00:47:02.372172 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:02.372175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:02.372236 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:02.372317 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:02.373032 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.373833 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.374977 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.375418 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.375523 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:02.380066 (+ 4543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:42837: BlockingRecv error: recv got EOF from 127.28.92.131:42837 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 00:47:02 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:02 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:02.789485 12208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:02.780605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:43347)
0809 00:47:02.781238 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:02.781259 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:02.781420 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:02.781753 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:02.781757 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:02.782153 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:02.782327 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:02.782335 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.783502 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.783506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:02.784459 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:02.784471 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.785116 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.785119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:02.785272 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:02.785918 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:02.785935 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:02.789245 (+ 3310us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":275,"threads_started":1}
W20260809 00:47:02.789742 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:02.780714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:43347 (local address 127.28.92.190:34197)
0809 00:47:02.781020 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:02.781027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:02.781348 (+ 321us) server_negotiation.cc:407] Connection header received
0809 00:47:02.781552 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:02.781556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:02.781619 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:02.781739 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:02.782464 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.783359 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.784576 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:02.785000 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:02.785094 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:02.789476 (+ 4382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:43347: BlockingRecv error: recv got EOF from 127.28.92.130:43347 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
Aug 09 00:47:03 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:03 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:03.160362 12210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:03.151343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:36983)
0809 00:47:03.151871 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:03.151892 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:03.152028 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:03.152361 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:03.152363 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:03.152867 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:03.153064 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:03.153077 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.154437 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.154441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:03.155421 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:03.155435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.156102 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.156106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:03.156217 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:03.156771 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:03.156788 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:03.160113 (+ 3325us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":271,"threads_started":1}
W20260809 00:47:03.160758 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:03.151463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:36983 (local address 127.28.92.190:34197)
0809 00:47:03.151687 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:03.151694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:03.151971 (+ 277us) server_negotiation.cc:407] Connection header received
0809 00:47:03.152133 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:03.152138 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:03.152224 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:03.152329 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:03.153222 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.154305 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.155543 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.155967 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.156056 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:03.160380 (+ 4324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:36983: BlockingRecv error: recv got EOF from 127.28.92.129:36983 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 00:47:03 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:03 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:03.389544 12211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:03.381118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:49861)
0809 00:47:03.381762 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:03.381778 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:03.381900 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:03.382184 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:03.382188 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:03.382581 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:03.382754 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:03.382762 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.383807 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.383811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:03.384801 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:03.384814 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.385434 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.385438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:03.385544 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:03.386075 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:03.386093 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:03.389289 (+ 3196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":276,"threads_started":1}
W20260809 00:47:03.389698 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:03.381261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:49861 (local address 127.28.92.190:34197)
0809 00:47:03.381418 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:03.381423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:03.381842 (+ 419us) server_negotiation.cc:407] Connection header received
0809 00:47:03.381998 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:03.382002 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:03.382064 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:03.382141 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:03.382879 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.383694 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.384912 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.385326 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.385415 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:03.389471 (+ 4056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:49861: BlockingRecv error: recv got EOF from 127.28.92.131:49861 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 00:47:03 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:03 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:03.799275 12213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:03.790453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:54063)
0809 00:47:03.790980 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:03.790995 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:03.791125 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:03.791444 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:03.791449 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:03.791871 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:03.792047 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:03.792057 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.793240 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.793244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:03.794219 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:03.794231 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.794962 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.794968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:03.795115 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:03.795673 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:03.795689 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:03.798930 (+ 3241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":269,"threads_started":1}
W20260809 00:47:03.799404 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:03.790527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:54063 (local address 127.28.92.190:34197)
0809 00:47:03.790711 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:03.790717 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:03.791079 (+ 362us) server_negotiation.cc:407] Connection header received
0809 00:47:03.791242 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:03.791247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:03.791316 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:03.791393 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:03.792187 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.793100 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.794350 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:03.794780 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:03.794899 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:03.799155 (+ 4256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:54063: BlockingRecv error: recv got EOF from 127.28.92.130:54063 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 09 00:47:04 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:04 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:04.172940 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:04.161309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:50299)
0809 00:47:04.161880 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:04.161902 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:04.162021 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:04.162359 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:04.162362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:04.162756 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:04.162915 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:04.162923 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.163919 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.163924 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:04.164905 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:04.164918 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.165868 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.165875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:04.166044 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:04.169262 (+ 3218us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:04.169285 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:04.172628 (+ 3343us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":278,"threads_started":1}
W20260809 00:47:04.173163 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:04.161356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:50299 (local address 127.28.92.190:34197)
0809 00:47:04.161533 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:04.161538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:04.161974 (+ 436us) server_negotiation.cc:407] Connection header received
0809 00:47:04.162107 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:04.162112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:04.162194 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:04.162303 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:04.163042 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.163758 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.165069 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.165698 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.165826 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:04.172929 (+ 7103us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:50299: BlockingRecv error: recv got EOF from 127.28.92.129:50299 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 00:47:04 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:04 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:04.399212 12216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:04.390483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:40903)
0809 00:47:04.391036 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:04.391052 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:04.391167 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:04.391421 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:04.391423 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:04.391840 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:04.392009 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:04.392019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.392937 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.392940 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:04.393926 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:04.393940 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.394576 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.394580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:04.394687 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:04.395262 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:04.395280 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:04.398897 (+ 3617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":289,"threads_started":1}
W20260809 00:47:04.399286 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:04.390586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:40903 (local address 127.28.92.190:34197)
0809 00:47:04.390738 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:04.390742 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:04.391116 (+ 374us) server_negotiation.cc:407] Connection header received
0809 00:47:04.391253 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:04.391257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:04.391316 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:04.391391 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:04.392123 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.392835 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.394029 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.394440 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.394528 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:04.399035 (+ 4507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:40903: BlockingRecv error: recv got EOF from 127.28.92.131:40903 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 00:47:04 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:04 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:04.809280 12219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:04.800317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:41857)
0809 00:47:04.800834 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:04.800851 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:04.800980 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:04.801281 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:04.801284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:04.801772 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:04.801926 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:04.801936 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.802900 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.802903 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:04.803840 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:04.803851 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.804490 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.804494 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:04.804614 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:04.805213 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:04.805237 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:04.808917 (+ 3680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":297,"threads_started":1}
W20260809 00:47:04.809362 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:04.800459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:41857 (local address 127.28.92.190:34197)
0809 00:47:04.800644 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:04.800649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:04.800921 (+ 272us) server_negotiation.cc:407] Connection header received
0809 00:47:04.801083 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:04.801087 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:04.801152 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:04.801237 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:04.802059 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.802795 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.803957 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:04.804358 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:04.804447 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:04.809122 (+ 4675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:41857: BlockingRecv error: recv got EOF from 127.28.92.130:41857 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 00:47:05 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:05 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:05.182482 12220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:05.173941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:38167)
0809 00:47:05.174507 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:05.174532 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:05.174676 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:05.174970 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:05.174973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:05.175343 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:05.175527 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:05.175536 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.176476 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.176479 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:05.177461 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:05.177471 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.178167 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.178171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:05.178289 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:05.178807 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:05.178823 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:05.182109 (+ 3286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":288,"threads_started":1}
W20260809 00:47:05.182592 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:05.174047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:38167 (local address 127.28.92.190:34197)
0809 00:47:05.174238 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:05.174244 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:05.174626 (+ 382us) server_negotiation.cc:407] Connection header received
0809 00:47:05.174778 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:05.174782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:05.174848 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:05.174925 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:05.175641 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.176375 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.177564 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.178024 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.178124 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:05.182339 (+ 4215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:38167: BlockingRecv error: recv got EOF from 127.28.92.129:38167 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 00:47:05 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:05 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:05.408708 12228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:05.400201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:32869)
0809 00:47:05.400656 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:05.400672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:05.400791 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:05.401068 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:05.401071 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:05.401469 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:05.401613 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:05.401621 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.402562 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.402565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:05.403590 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:05.403604 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.404264 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.404268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:05.404392 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:05.404948 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:05.404964 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:05.408376 (+ 3412us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":240,"threads_started":1}
W20260809 00:47:05.408804 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:05.400270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:32869 (local address 127.28.92.190:34197)
0809 00:47:05.400515 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:05.400521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:05.400743 (+ 222us) server_negotiation.cc:407] Connection header received
0809 00:47:05.400885 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:05.400888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:05.400960 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:05.401036 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:05.401737 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.402449 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.403709 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.404145 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.404236 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:05.408597 (+ 4361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:32869: BlockingRecv error: recv got EOF from 127.28.92.131:32869 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 09 00:47:05 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:05 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:05.819480 12229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:05.810231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:33913)
0809 00:47:05.810763 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:05.810797 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:05.810964 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:05.811526 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:05.811591 (+ 65us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:05.812156 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:05.812368 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:05.812386 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.813411 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.813414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:05.814462 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:05.814474 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.815097 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.815101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:05.815213 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:05.815812 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:05.815830 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:05.819223 (+ 3393us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":288,"threads_started":1}
W20260809 00:47:05.819648 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:05.810290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:33913 (local address 127.28.92.190:34197)
0809 00:47:05.810472 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:05.810477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:05.810890 (+ 413us) server_negotiation.cc:407] Connection header received
0809 00:47:05.811262 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:05.811267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:05.811347 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:05.811469 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:05.812544 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.813271 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.814574 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:05.814982 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:05.815068 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:05.819410 (+ 4342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:33913: BlockingRecv error: recv got EOF from 127.28.92.130:33913 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 00:47:06 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:06 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:06.193347 12230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:06.183577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:59249)
0809 00:47:06.184156 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:06.184180 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:06.184326 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:06.184698 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:06.184702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:06.185173 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:06.185367 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:06.185376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.186394 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.186398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:06.187343 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:06.187354 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.187948 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.187951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:06.188076 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:06.188640 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:06.188663 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:06.193011 (+ 4348us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":298,"threads_started":1}
W20260809 00:47:06.193547 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:06.183721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:59249 (local address 127.28.92.190:34197)
0809 00:47:06.183971 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:06.183977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:06.184267 (+ 290us) server_negotiation.cc:407] Connection header received
0809 00:47:06.184459 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:06.184465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:06.184540 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:06.184633 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:06.185493 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.186282 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.187459 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.187835 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.187923 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:06.193281 (+ 5358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:59249: BlockingRecv error: recv got EOF from 127.28.92.129:59249 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 09 00:47:06 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:06 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:06.418784 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:06.409847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:48835)
0809 00:47:06.410398 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:06.410414 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:06.410556 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:06.410875 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:06.410879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:06.411365 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:06.411588 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:06.411603 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.412928 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.412934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:06.414041 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:06.414055 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.414702 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.414706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:06.414816 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:06.415348 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:06.415364 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:06.418546 (+ 3182us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":294,"threads_started":1}
W20260809 00:47:06.418972 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:06.409968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:48835 (local address 127.28.92.190:34197)
0809 00:47:06.410175 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:06.410183 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:06.410500 (+ 317us) server_negotiation.cc:407] Connection header received
0809 00:47:06.410674 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:06.410678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:06.410743 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:06.410825 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:06.411748 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.412787 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.414161 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.414587 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.414682 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:06.418734 (+ 4052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:48835: BlockingRecv error: recv got EOF from 127.28.92.131:48835 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 00:47:06 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:06 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:06.829200 12234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:06.820423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:47385)
0809 00:47:06.820950 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:06.820967 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:06.821099 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:06.821444 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:06.821465 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:06.821900 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:06.822083 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:06.822092 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.823114 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.823120 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:06.824041 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:06.824053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.824756 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.824762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:06.824931 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:06.825555 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:06.825575 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:06.828976 (+ 3401us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":308,"threads_started":1}
W20260809 00:47:06.829365 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:06.820523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:47385 (local address 127.28.92.190:34197)
0809 00:47:06.820734 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:06.820741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:06.821052 (+ 311us) server_negotiation.cc:407] Connection header received
0809 00:47:06.821221 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:06.821226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:06.821290 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:06.821371 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:06.822225 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.822981 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.824177 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:06.824607 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:06.824716 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:06.829147 (+ 4431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:47385: BlockingRecv error: recv got EOF from 127.28.92.130:47385 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 00:47:07 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:07 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:07.203322 12235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:07.194504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:35245)
0809 00:47:07.194986 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:07.195007 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:07.195126 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:07.195398 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:07.195401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:07.195796 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:07.195990 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:07.196000 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.196987 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.196991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:07.198014 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:07.198028 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.198649 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.198653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:07.198783 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:07.199344 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:07.199361 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:07.202988 (+ 3627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":253,"threads_started":1}
W20260809 00:47:07.203465 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:07.194554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:35245 (local address 127.28.92.190:34197)
0809 00:47:07.194773 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:07.194781 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:07.195076 (+ 295us) server_negotiation.cc:407] Connection header received
0809 00:47:07.195233 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:07.195237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:07.195300 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:07.195369 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:07.196100 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.196864 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.198134 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.198541 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.198633 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:07.203223 (+ 4590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:35245: BlockingRecv error: recv got EOF from 127.28.92.129:35245 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 09 00:47:07 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:07 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:07.428031 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:07.419695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:47957)
0809 00:47:07.420250 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:07.420267 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:07.420380 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:07.420647 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:07.420650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:07.421086 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:07.421260 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:07.421269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.422267 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.422270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:07.423206 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:07.423218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.423833 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.423836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:07.423967 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:07.424542 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:07.424559 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:07.427796 (+ 3237us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":306,"threads_started":1}
W20260809 00:47:07.428264 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:07.419768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:47957 (local address 127.28.92.190:34197)
0809 00:47:07.419926 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:07.419931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:07.420329 (+ 398us) server_negotiation.cc:407] Connection header received
0809 00:47:07.420473 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:07.420477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:07.420537 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:07.420613 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:07.421374 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.422170 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.423314 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.423720 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.423807 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:07.428030 (+ 4223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:47957: BlockingRecv error: recv got EOF from 127.28.92.131:47957 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 00:47:07 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:07 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:07.839319 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:07.830140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:45507)
0809 00:47:07.830729 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:07.830746 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:07.830864 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:07.831151 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:07.831154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:07.831575 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:07.831756 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:07.831765 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.832760 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.832764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:07.833758 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:07.833771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.834719 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.834727 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:07.834921 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:07.835644 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:07.835662 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:07.838988 (+ 3326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":316,"threads_started":1}
W20260809 00:47:07.839494 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:07.830203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:45507 (local address 127.28.92.190:34197)
0809 00:47:07.830378 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:07.830383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:07.830810 (+ 427us) server_negotiation.cc:407] Connection header received
0809 00:47:07.830971 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:07.830975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:07.831036 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:07.831116 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:07.831884 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.832650 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.833896 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:07.834524 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:07.834637 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:07.839228 (+ 4591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:45507: BlockingRecv error: recv got EOF from 127.28.92.130:45507 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 00:47:08 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:08 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:08.212642 12239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:08.204264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:40455)
0809 00:47:08.204713 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:08.204731 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:08.204842 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:08.205099 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:08.205102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:08.205517 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:08.205706 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:08.205720 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.206618 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.206621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:08.207536 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:08.207547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.208152 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.208155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:08.208273 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:08.208856 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:08.208874 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:08.212348 (+ 3474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":238,"threads_started":1}
W20260809 00:47:08.212867 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:08.204325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:40455 (local address 127.28.92.190:34197)
0809 00:47:08.204529 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:08.204536 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:08.204799 (+ 263us) server_negotiation.cc:407] Connection header received
0809 00:47:08.204924 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:08.204927 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:08.204992 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:08.205071 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:08.205824 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.206504 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.207640 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.208047 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.208136 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:08.212578 (+ 4442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:40455: BlockingRecv error: recv got EOF from 127.28.92.129:40455 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 00:47:08 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:08 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:08.438330 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:08.429105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:52275)
0809 00:47:08.429596 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:08.429614 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:08.429769 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:08.430157 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:08.430161 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:08.430588 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:08.430768 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:08.430777 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.431793 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.431797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:08.432715 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:08.432727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.433402 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.433406 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:08.433535 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:08.434178 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:08.434195 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:08.437993 (+ 3798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":255,"threads_started":1}
W20260809 00:47:08.438475 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:08.429159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:52275 (local address 127.28.92.190:34197)
0809 00:47:08.429373 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:08.429381 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:08.429740 (+ 359us) server_negotiation.cc:407] Connection header received
0809 00:47:08.429887 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:08.429891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:08.429974 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:08.430083 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:08.430905 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.431674 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.432845 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.433261 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.433354 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:08.438208 (+ 4854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:52275: BlockingRecv error: recv got EOF from 127.28.92.131:52275 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 00:47:08 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:08 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:08.849221 12242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:08.840396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:45095)
0809 00:47:08.840839 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:08.840856 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:08.840964 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:08.841313 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:08.841316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:08.841771 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:08.841955 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:08.841965 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.842960 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.842965 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:08.843866 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:08.843877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.844665 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.844671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:08.844830 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:08.845462 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:08.845489 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:08.848996 (+ 3507us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":234,"threads_started":1}
W20260809 00:47:08.849442 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:08.840714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:45095 (local address 127.28.92.190:34197)
0809 00:47:08.840914 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:08.840918 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:08.840936 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:47:08.841126 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:08.841132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:08.841200 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:08.841285 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:08.842094 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.842850 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.843990 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:08.844524 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:08.844648 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:08.849186 (+ 4538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:45095: BlockingRecv error: recv got EOF from 127.28.92.130:45095 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 09 00:47:09 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:09 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:09.226372 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:09.214032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:58427)
0809 00:47:09.214564 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:09.214582 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:09.214715 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:09.215029 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:09.215034 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:09.215496 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:09.215749 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:09.215763 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.217072 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.217077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:09.218061 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:09.218074 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.218731 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.218735 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:09.218852 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:09.222712 (+ 3860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:09.222730 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:09.226128 (+ 3398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":259,"threads_started":1}
W20260809 00:47:09.226567 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:09.214159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:58427 (local address 127.28.92.190:34197)
0809 00:47:09.214359 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:09.214366 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:09.214666 (+ 300us) server_negotiation.cc:407] Connection header received
0809 00:47:09.214830 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:09.214834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:09.214899 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:09.214994 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:09.215895 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.216911 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.218177 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.218613 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.218705 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:09.226334 (+ 7629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:58427: BlockingRecv error: recv got EOF from 127.28.92.129:58427 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 00:47:09 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:09 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.131@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:09.448000 12246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:09.439477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.131:33171)
0809 00:47:09.440031 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:09.440052 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:09.440206 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:09.440568 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:09.440574 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:09.441071 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:09.441241 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:09.441254 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.442317 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.442322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:09.443310 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:09.443323 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.443924 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.443928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:09.444055 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:09.444576 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:09.444593 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:09.447759 (+ 3166us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":310,"threads_started":1}
W20260809 00:47:09.448137 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:09.439507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:33171 (local address 127.28.92.190:34197)
0809 00:47:09.439816 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:09.439822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:09.440144 (+ 322us) server_negotiation.cc:407] Connection header received
0809 00:47:09.440337 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:09.440342 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:09.440409 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:09.440494 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:09.441376 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.442202 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.443427 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.443813 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.443905 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:09.447951 (+ 4046us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.131:33171: BlockingRecv error: recv got EOF from 127.28.92.131:33171 (error 108)
Metrics: {"server-negotiator.queue_time_us":160}
Aug 09 00:47:09 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:09 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.130@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:09.859906 12247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:09.850343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.130:57839)
0809 00:47:09.850896 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:09.850913 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:09.851055 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:09.851428 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:09.851434 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:09.851901 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:09.852111 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:09.852122 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.853271 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.853276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:09.854315 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:09.854329 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.855153 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.855159 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:09.855351 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:09.856001 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:09.856020 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:09.859547 (+ 3527us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":258,"threads_started":1}
W20260809 00:47:09.860095 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:09.850527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:57839 (local address 127.28.92.190:34197)
0809 00:47:09.850774 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:09.850781 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:09.850992 (+ 211us) server_negotiation.cc:407] Connection header received
0809 00:47:09.851187 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:09.851193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:09.851277 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:09.851374 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:09.852277 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.853110 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.854470 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:09.854987 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:09.855113 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:09.859792 (+ 4679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.130:57839: BlockingRecv error: recv got EOF from 127.28.92.130:57839 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 09 00:47:10 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 00:47:10 dist-test-slave-t7g5 krb5kdc[10459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.28.92.129@KRBTEST.COM for oryx/127.28.92.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 00:47:10.236274 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:10.227324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34197 (local address 127.28.92.129:56377)
0809 00:47:10.227884 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:10.227905 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:10.228063 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:10.228391 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:10.228395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:10.228813 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:10.229012 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:10.229025 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.230090 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.230096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:10.231043 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:10.231055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.231802 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.231808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:10.231971 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:10.232594 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:10.232614 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:10.236028 (+ 3414us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.28.92.190:34197: Server oryx/127.28.92.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":318,"threads_started":1}
W20260809 00:47:10.236449 12165 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:10.227422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:56377 (local address 127.28.92.190:34197)
0809 00:47:10.227619 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:10.227625 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:10.227994 (+ 369us) server_negotiation.cc:407] Connection header received
0809 00:47:10.228182 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:10.228186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:10.228250 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:10.228332 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:10.229172 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.229953 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.231182 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.231647 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.231763 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:10.236213 (+ 4450us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.28.92.129:56377: BlockingRecv error: recv got EOF from 127.28.92.129:56377 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 00:47:10.291847 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11463
I20260809 00:47:10.304245 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:10.293084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58764 (local address 127.28.92.129:40941)
0809 00:47:10.293794 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:10.293802 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:10.293833 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:47:10.293904 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:10.293911 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:10.294155 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:10.294322 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:10.295763 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.296877 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.298142 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.298689 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.298788 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:10.301178 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:10.301186 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:10.301201 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:10.301238 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:10.303676 (+ 2438us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.92.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 00:47:10.303978 (+ 302us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58764: Request ticket server kudu/127.28.92.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":357,"threads_started":1}
W20260809 00:47:10.304359 12253 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58764: Request ticket server kudu/127.28.92.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 00:47:10.304358 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11463: Not authorized: Client connection negotiation failed: client connection to 127.28.92.129:40941: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.92.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 00:47:10.304636 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 11463
I20260809 00:47:10.332466 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11721
I20260809 00:47:10.345160 12254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:10.333591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32912 (local address 127.28.92.130:41661)
0809 00:47:10.334239 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:10.334246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:10.334274 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:47:10.334336 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:10.334342 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:10.334639 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:10.334830 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:10.336333 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.337488 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.338724 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.339307 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.339427 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:10.341936 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:10.341945 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:10.341969 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:10.342018 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:10.344479 (+ 2461us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.92.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 00:47:10.344822 (+ 343us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32912: Request ticket server kudu/127.28.92.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":236,"threads_started":1}
W20260809 00:47:10.345180 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11721: Not authorized: Client connection negotiation failed: client connection to 127.28.92.130:41661: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.92.130@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 00:47:10.345278 12254 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32912: Request ticket server kudu/127.28.92.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 00:47:10.345321 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 11721
I20260809 00:47:10.370481 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11946
I20260809 00:47:10.382823 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:10.371799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38098 (local address 127.28.92.131:41495)
0809 00:47:10.372393 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:10.372400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:10.372425 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:47:10.372495 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:10.372501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:10.372737 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:10.372894 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:10.374720 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.375756 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.376858 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:10.377394 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:10.377490 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:10.379871 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:10.379879 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:10.379893 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:10.379933 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:10.382289 (+ 2356us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.92.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 00:47:10.382562 (+ 273us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38098: Request ticket server kudu/127.28.92.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":272,"threads_started":1}
W20260809 00:47:10.382933 12255 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38098: Request ticket server kudu/127.28.92.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 00:47:10.382975 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11946: Not authorized: Client connection negotiation failed: client connection to 127.28.92.131:41495: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.28.92.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 00:47:10.383164 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 11946
I20260809 00:47:10.407285 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 11352
I20260809 00:47:10.408666 11449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:10.532087 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 11352
2026-08-09T00:47:10Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21647 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T00:47:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:47:10Z Disabled control of system clock
I20260809 00:47:10.618541 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:39069
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:37921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:39069
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 00:47:10.949138 12260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:10.949426 12260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:10.949522 12260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:10.956600 12260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:47:10.956700 12260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:10.956751 12260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:10.956807 12260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:47:10.956851 12260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:47:10.965871 12260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:39069
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:39069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:10.967161 12260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:10.968982 12260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:10.980665 12267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:10.980698 12269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:10.980891 12260 server_base.cc:1034] running on GCE node
W20260809 00:47:10.980719 12272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:10.982191 12260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:10.983626 12260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:10.984823 12260 hybrid_clock.cc:648] HybridClock initialized: now 1786236430984764 us; error 48 us; skew 500 ppm
I20260809 00:47:10.985172 12260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:10.987493 12260 webserver.cc:460] Webserver started at http://127.28.92.190:33317/ using document root <none> and password file <none>
I20260809 00:47:10.988193 12260 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:10.988294 12260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:10.988636 12260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:10.991739 12260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "fb5055c212d24bd4a4dc9ea6131d44a3"
format_stamp: "Formatted at 2026-08-09 00:47:10 on dist-test-slave-t7g5"
server_key: "27ada4ac8de574142d1e84132fd5dabd"
server_key_iv: "80b8cd05e087c86468e28568cce2c202"
server_key_version: "encryptionkey@0"
I20260809 00:47:10.992569 12260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "fb5055c212d24bd4a4dc9ea6131d44a3"
format_stamp: "Formatted at 2026-08-09 00:47:10 on dist-test-slave-t7g5"
server_key: "27ada4ac8de574142d1e84132fd5dabd"
server_key_iv: "80b8cd05e087c86468e28568cce2c202"
server_key_version: "encryptionkey@0"
I20260809 00:47:10.998034 12260 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:47:11.001513 12285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:11.002878 12260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:47:11.003050 12260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "fb5055c212d24bd4a4dc9ea6131d44a3"
format_stamp: "Formatted at 2026-08-09 00:47:10 on dist-test-slave-t7g5"
server_key: "27ada4ac8de574142d1e84132fd5dabd"
server_key_iv: "80b8cd05e087c86468e28568cce2c202"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.003259 12260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:11.031605 12260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:11.032542 12260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:11.032835 12260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:11.050519 12260 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:39069
I20260809 00:47:11.050489 12365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:39069 every 8 connection(s)
I20260809 00:47:11.051843 12260 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:47:11.055583 12366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:47:11.060918 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 12260
I20260809 00:47:11.061105 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:47:11.061968 29042 external_mini_cluster.cc:1428] Setting key 0d878e86a7cf5e3e0734ae3905fff097
I20260809 00:47:11.066536 12366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3: Bootstrap starting.
I20260809 00:47:11.069881 12366 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3: Neither blocks nor log segments found. Creating new log.
I20260809 00:47:11.071131 12366 log.cc:824] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3: Log is configured to *not* fsync() on all Append() calls
I20260809 00:47:11.074427 12366 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3: No bootstrap required, opened a new log
I20260809 00:47:11.076004 12369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:11.064129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34408 (local address 127.28.92.190:39069)
0809 00:47:11.065152 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:11.065163 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:11.065203 (+ 40us) server_negotiation.cc:407] Connection header received
0809 00:47:11.066861 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:11.066884 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:11.067316 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:11.067612 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:11.068314 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:11.069542 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:11.071375 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:11.072366 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:11.072545 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:11.073712 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:11.073721 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:11.073735 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:11.074254 (+ 519us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:11.074328 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:11.074350 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:11.074440 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:11.074696 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 00:47:11.075013 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":385,"threads_started":1}
I20260809 00:47:11.082787 12366 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39069 } }
I20260809 00:47:11.083154 12366 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:47:11.083254 12366 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb5055c212d24bd4a4dc9ea6131d44a3, State: Initialized, Role: FOLLOWER
I20260809 00:47:11.083786 12366 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39069 } }
I20260809 00:47:11.084053 12366 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:47:11.084203 12366 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:47:11.084375 12366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:47:11.086586 12366 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39069 } }
I20260809 00:47:11.087085 12366 leader_election.cc:302] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb5055c212d24bd4a4dc9ea6131d44a3; no voters:
I20260809 00:47:11.087677 12366 leader_election.cc:288] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:47:11.087857 12372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:47:11.088608 12372 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [term 1 LEADER]: Becoming Leader. State: Replica: fb5055c212d24bd4a4dc9ea6131d44a3, State: Running, Role: LEADER
I20260809 00:47:11.089164 12372 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39069 } }
I20260809 00:47:11.089761 12366 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:47:11.092305 12374 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39069 } } }
I20260809 00:47:11.092631 12374 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [sys.catalog]: This master's current role is: LEADER
I20260809 00:47:11.093063 12375 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb5055c212d24bd4a4dc9ea6131d44a3. Latest consensus state: current_term: 1 leader_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb5055c212d24bd4a4dc9ea6131d44a3" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39069 } } }
I20260809 00:47:11.093413 12375 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3 [sys.catalog]: This master's current role is: LEADER
I20260809 00:47:11.093621 12384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:47:11.099056 12384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:47:11.107127 12384 catalog_manager.cc:1347] Generated new cluster ID: 4f9093f02478495bb774659ea9ded9f4
I20260809 00:47:11.107246 12384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:47:11.122877 12384 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:47:11.124655 12384 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:47:11.142452 12384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb5055c212d24bd4a4dc9ea6131d44a3: Generated new TSK 0
I20260809 00:47:11.143324 12384 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:47:11.148705 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39069
--builtin_ntp_servers=127.28.92.148:37921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 00:47:11.476956 12406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:11.477315 12406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:11.477455 12406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:11.484819 12406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:11.484929 12406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:11.485086 12406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:47:11.494400 12406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39069
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:11.495761 12406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:11.497630 12406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:11.510958 12413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:11.510879 12414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:11.510914 12419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:11.512215 12406 server_base.cc:1034] running on GCE node
I20260809 00:47:11.512864 12406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:11.513833 12406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:11.515038 12406 hybrid_clock.cc:648] HybridClock initialized: now 1786236431514974 us; error 60 us; skew 500 ppm
I20260809 00:47:11.515354 12406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:11.517529 12406 webserver.cc:460] Webserver started at http://127.28.92.129:34617/ using document root <none> and password file <none>
I20260809 00:47:11.518268 12406 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:11.518371 12406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:11.518689 12406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:11.521497 12406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "f75f30d8c1e74ae1aa9ab5b49ce35050"
format_stamp: "Formatted at 2026-08-09 00:47:11 on dist-test-slave-t7g5"
server_key: "893e1e9554ffc6bf7dcd280f4ffb4ecf"
server_key_iv: "03cb37b13d3b1d075f17889efa8ec18e"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.522320 12406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "f75f30d8c1e74ae1aa9ab5b49ce35050"
format_stamp: "Formatted at 2026-08-09 00:47:11 on dist-test-slave-t7g5"
server_key: "893e1e9554ffc6bf7dcd280f4ffb4ecf"
server_key_iv: "03cb37b13d3b1d075f17889efa8ec18e"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.527380 12406 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:47:11.530759 12427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:11.532074 12406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260809 00:47:11.532238 12406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "f75f30d8c1e74ae1aa9ab5b49ce35050"
format_stamp: "Formatted at 2026-08-09 00:47:11 on dist-test-slave-t7g5"
server_key: "893e1e9554ffc6bf7dcd280f4ffb4ecf"
server_key_iv: "03cb37b13d3b1d075f17889efa8ec18e"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.532442 12406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:11.556143 12406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:11.557063 12406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:11.557363 12406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:11.558382 12406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:11.559888 12406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:11.559980 12406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:11.560091 12406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:11.560165 12406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:11.590682 12406 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:46259
I20260809 00:47:11.590744 12613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:46259 every 8 connection(s)
I20260809 00:47:11.591964 12406 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:47:11.594513 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 12406
I20260809 00:47:11.594720 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:47:11.595669 29042 external_mini_cluster.cc:1428] Setting key a31434bf7ed5ec9557e7022565d164e5
I20260809 00:47:11.598665 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39069
--builtin_ntp_servers=127.28.92.148:37921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 00:47:11.605017 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:11.594490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54279 (local address 127.28.92.190:39069)
0809 00:47:11.596621 (+ 2131us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:11.596627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:11.596652 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:47:11.598465 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:11.598471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:11.598555 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:11.598676 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:11.599739 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:11.600753 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:11.602329 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:11.602866 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:11.602991 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:11.604243 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:11.604248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:11.604252 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:11.604273 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:11.604323 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:11.604336 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:11.604415 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:11.604601 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 00:47:11.604702 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2022,"thread_start_us":1915,"threads_started":1}
I20260809 00:47:11.606004 12621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:11.595034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39069 (local address 127.28.92.129:54279)
0809 00:47:11.596129 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:11.596183 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:11.598205 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:11.598871 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:11.598883 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:11.598990 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:11.599546 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:11.599564 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:11.600906 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:11.600910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:11.602194 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:11.602207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:11.603044 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:11.603049 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:11.603251 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:11.603909 (+ 658us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:47:11.603911 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:11.603954 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:47:11.604059 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:11.604421 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:11.604427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:11.604432 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:47:11.604570 (+ 138us) client_negotiation.cc:240] Negotiation successful
0809 00:47:11.604869 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":293,"threads_started":1}
I20260809 00:47:11.607462 12614 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39069
I20260809 00:47:11.607756 12614 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:11.608541 12614 heartbeater.cc:511] Master 127.28.92.190:39069 requested a full tablet report, sending...
I20260809 00:47:11.610698 12314 ts_manager.cc:194] Registered new tserver with Master: f75f30d8c1e74ae1aa9ab5b49ce35050 (127.28.92.129:46259)
I20260809 00:47:11.612268 12314 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.129:54279
W20260809 00:47:11.932543 12624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:11.932826 12624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:11.932953 12624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:11.940274 12624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:11.940379 12624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:11.940523 12624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:47:11.949553 12624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39069
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:11.950834 12624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:11.952625 12624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:11.965339 12632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:11.965442 12629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:11.965423 12635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:11.966497 12624 server_base.cc:1034] running on GCE node
I20260809 00:47:11.967123 12624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:11.968008 12624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:11.969208 12624 hybrid_clock.cc:648] HybridClock initialized: now 1786236431969150 us; error 49 us; skew 500 ppm
I20260809 00:47:11.969511 12624 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:11.971658 12624 webserver.cc:460] Webserver started at http://127.28.92.130:35985/ using document root <none> and password file <none>
I20260809 00:47:11.972321 12624 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:11.972424 12624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:11.972738 12624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:11.975533 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "499520a1f3bf4d7c8160063cf26d2324"
format_stamp: "Formatted at 2026-08-09 00:47:11 on dist-test-slave-t7g5"
server_key: "68ea514fd07d74156d71f286b0a4ba86"
server_key_iv: "0ea56591409589cb438099665bde91f5"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.976315 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "499520a1f3bf4d7c8160063cf26d2324"
format_stamp: "Formatted at 2026-08-09 00:47:11 on dist-test-slave-t7g5"
server_key: "68ea514fd07d74156d71f286b0a4ba86"
server_key_iv: "0ea56591409589cb438099665bde91f5"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.981323 12624 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:47:11.984586 12644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:11.985965 12624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 00:47:11.986115 12624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "499520a1f3bf4d7c8160063cf26d2324"
format_stamp: "Formatted at 2026-08-09 00:47:11 on dist-test-slave-t7g5"
server_key: "68ea514fd07d74156d71f286b0a4ba86"
server_key_iv: "0ea56591409589cb438099665bde91f5"
server_key_version: "encryptionkey@0"
I20260809 00:47:11.986306 12624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:12.014079 12624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:12.014989 12624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:12.015285 12624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:12.016335 12624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:12.017827 12624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:12.017928 12624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:12.018049 12624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:12.018123 12624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:12.048419 12624 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:34473
I20260809 00:47:12.048501 12815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:34473 every 8 connection(s)
I20260809 00:47:12.049839 12624 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:47:12.056710 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 12624
I20260809 00:47:12.056877 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:47:12.057418 29042 external_mini_cluster.cc:1428] Setting key 42c07b65fa575e3f475bd8ac9a8e90ac
I20260809 00:47:12.060747 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39069
--builtin_ntp_servers=127.28.92.148:37921
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 00:47:12.063941 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.052535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:40185 (local address 127.28.92.190:39069)
0809 00:47:12.052703 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:12.052707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:12.054323 (+ 1616us) server_negotiation.cc:407] Connection header received
0809 00:47:12.056101 (+ 1778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:12.056107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:12.056189 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:12.056279 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:12.057426 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.058356 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.060315 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.060731 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.060837 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.063151 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:12.063156 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:12.063160 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:12.063176 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:12.063208 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:12.063219 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:12.063294 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:12.063519 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 00:47:12.063620 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 00:47:12.065060 12818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.053187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39069 (local address 127.28.92.130:40185)
0809 00:47:12.054165 (+ 978us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:12.054206 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:12.055826 (+ 1620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:12.056525 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:12.056533 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:12.056624 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:12.057264 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:12.057282 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.058506 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.058511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:12.060178 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:12.060191 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.060966 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.060975 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:12.061179 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.062829 (+ 1650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:47:12.062832 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:12.062875 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:47:12.062970 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:12.063304 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:12.063317 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:12.063326 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 00:47:12.063499 (+ 173us) client_negotiation.cc:240] Negotiation successful
0809 00:47:12.063894 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":292,"threads_started":1}
I20260809 00:47:12.066490 12816 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39069
I20260809 00:47:12.066793 12816 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:12.067561 12816 heartbeater.cc:511] Master 127.28.92.190:39069 requested a full tablet report, sending...
I20260809 00:47:12.068933 12314 ts_manager.cc:194] Registered new tserver with Master: 499520a1f3bf4d7c8160063cf26d2324 (127.28.92.130:34473)
I20260809 00:47:12.069777 12314 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.130:40185
W20260809 00:47:12.393204 12820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:12.393496 12820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:12.393632 12820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:12.400916 12820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:12.401038 12820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:12.401178 12820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:47:12.410189 12820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37921
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39069
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:12.411491 12820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:12.413282 12820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:12.425760 12828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:12.425799 12832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:12.425848 12830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:12.426880 12820 server_base.cc:1034] running on GCE node
I20260809 00:47:12.427434 12820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:12.428329 12820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:12.429524 12820 hybrid_clock.cc:648] HybridClock initialized: now 1786236432429479 us; error 48 us; skew 500 ppm
I20260809 00:47:12.429857 12820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:12.431898 12820 webserver.cc:460] Webserver started at http://127.28.92.131:39323/ using document root <none> and password file <none>
I20260809 00:47:12.432552 12820 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:12.432658 12820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:12.432976 12820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:12.435770 12820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "40691670019740abb2d18e64693ba537"
format_stamp: "Formatted at 2026-08-09 00:47:12 on dist-test-slave-t7g5"
server_key: "47a98723fe69d0e9dd30f43b7434d5d3"
server_key_iv: "6b58f68f0809fb2897e7e72796dce629"
server_key_version: "encryptionkey@0"
I20260809 00:47:12.436553 12820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "40691670019740abb2d18e64693ba537"
format_stamp: "Formatted at 2026-08-09 00:47:12 on dist-test-slave-t7g5"
server_key: "47a98723fe69d0e9dd30f43b7434d5d3"
server_key_iv: "6b58f68f0809fb2897e7e72796dce629"
server_key_version: "encryptionkey@0"
I20260809 00:47:12.441529 12820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260809 00:47:12.444833 12840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:12.446143 12820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:47:12.446305 12820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "40691670019740abb2d18e64693ba537"
format_stamp: "Formatted at 2026-08-09 00:47:12 on dist-test-slave-t7g5"
server_key: "47a98723fe69d0e9dd30f43b7434d5d3"
server_key_iv: "6b58f68f0809fb2897e7e72796dce629"
server_key_version: "encryptionkey@0"
I20260809 00:47:12.446504 12820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:12.477880 12820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:12.479251 12820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:12.479632 12820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:12.480911 12820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:12.482452 12820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:12.482549 12820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:12.482645 12820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:12.482702 12820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:12.519505 12820 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:38703
I20260809 00:47:12.519567 13029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:38703 every 8 connection(s)
I20260809 00:47:12.520787 12820 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:47:12.527488 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 12820
I20260809 00:47:12.527632 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:47:12.528066 29042 external_mini_cluster.cc:1428] Setting key 6d83ad09d443fac3f71ade115e1efff9
I20260809 00:47:12.533260 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.523315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:57095 (local address 127.28.92.190:39069)
0809 00:47:12.523498 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:12.523503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:12.524994 (+ 1491us) server_negotiation.cc:407] Connection header received
0809 00:47:12.526823 (+ 1829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:12.526829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:12.526915 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:12.527004 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:12.528175 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.528944 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.530696 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.531234 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.531329 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.532599 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:12.532603 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:12.532606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:12.532623 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:12.532649 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:12.532660 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:12.532725 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:12.532912 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 00:47:12.533029 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:47:12.534250 13035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.523894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39069 (local address 127.28.92.131:57095)
0809 00:47:12.524818 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:12.524864 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:12.526544 (+ 1680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:12.527273 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:12.527282 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:12.527371 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:12.528003 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:12.528022 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.529125 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.529129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:12.530553 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:12.530565 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.531441 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.531446 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:12.531645 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.532313 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:47:12.532316 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:12.532366 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:47:12.532446 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:12.532731 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:12.532737 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:12.532742 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:47:12.532902 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 00:47:12.533193 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":286,"threads_started":1}
I20260809 00:47:12.535424 13030 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39069
I20260809 00:47:12.535727 13030 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:12.536500 13030 heartbeater.cc:511] Master 127.28.92.190:39069 requested a full tablet report, sending...
I20260809 00:47:12.537848 12314 ts_manager.cc:194] Registered new tserver with Master: 40691670019740abb2d18e64693ba537 (127.28.92.131:38703)
I20260809 00:47:12.538589 12314 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.131:57095
I20260809 00:47:12.543143 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 00:47:12.549288 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:12.547729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34414 (local address 127.28.92.190:39069)
0809 00:47:12.547902 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:12.547907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:12.548385 (+ 478us) server_negotiation.cc:407] Connection header received
0809 00:47:12.548538 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:12.548542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:12.548619 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:12.548705 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:12.549101 (+ 396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34414: BlockingRecv error: recv got EOF from 127.0.0.1:34414 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:47:12.549888 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 12406
I20260809 00:47:12.557471 13045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.550941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55410 (local address 127.28.92.129:46259)
0809 00:47:12.551515 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:12.551522 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:12.551555 (+ 33us) server_negotiation.cc:407] Connection header received
0809 00:47:12.551613 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:12.551619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:12.551834 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:12.551962 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:12.552300 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.553280 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.554493 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.555058 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.555152 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.556104 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:12.556114 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:12.556126 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:12.556728 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:12.556780 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:12.556800 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:12.556891 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:12.557003 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 00:47:12.557123 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":277,"threads_started":1}
I20260809 00:47:12.558741 12606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:12.637543 12614 heartbeater.cc:503] Master 127.28.92.190:39069 was elected leader, sending a full tablet report...
I20260809 00:47:12.638998 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 12406
W20260809 00:47:12.661430 12290 connection.cc:535] server connection from 127.28.92.129:54279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 00:47:12.661799 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 12624
I20260809 00:47:12.669157 13049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.662663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36848 (local address 127.28.92.130:34473)
0809 00:47:12.663155 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:12.663165 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:12.663197 (+ 32us) server_negotiation.cc:407] Connection header received
0809 00:47:12.663261 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:12.663268 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:12.663499 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:12.663624 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:12.664012 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.664979 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.666261 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.666824 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.666921 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.667808 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:12.667815 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:12.667827 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:12.668408 (+ 581us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:12.668468 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:12.668488 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:12.668573 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:12.668681 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 00:47:12.668804 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":237,"threads_started":1}
I20260809 00:47:12.670405 12809 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:12.749316 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 12624
I20260809 00:47:12.769306 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 12820
I20260809 00:47:12.777211 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:12.770185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41644 (local address 127.28.92.131:38703)
0809 00:47:12.770728 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:12.770735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:12.770764 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:47:12.770823 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:12.770829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:12.771056 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:12.771197 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:12.771659 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.772695 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.774089 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:12.774656 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:12.774771 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:12.775826 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:12.775835 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:12.775849 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:12.776415 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:12.776471 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:12.776493 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:12.776607 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:12.776742 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 00:47:12.776870 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":251,"threads_started":1}
I20260809 00:47:12.778548 13022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:12.858480 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 12820
I20260809 00:47:12.880043 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 12260
I20260809 00:47:12.881232 12361 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:12.983819 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 12260
2026-08-09T00:47:13Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2444 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T00:47:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:47:13Z Disabled control of system clock
I20260809 00:47:13.065989 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:45471
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:45471
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 00:47:13.401119 13062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:13.401397 13062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:13.401486 13062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:13.408454 13062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:47:13.408567 13062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:13.408613 13062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:13.408674 13062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:47:13.408720 13062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:47:13.417722 13062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:45471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:45471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:13.418946 13062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:13.420712 13062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:13.432201 13073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:13.432302 13074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:13.432248 13077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:13.433046 13062 server_base.cc:1034] running on GCE node
I20260809 00:47:13.433851 13062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:13.435114 13062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:13.436316 13062 hybrid_clock.cc:648] HybridClock initialized: now 1786236433436283 us; error 29 us; skew 500 ppm
I20260809 00:47:13.436614 13062 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:13.438685 13062 webserver.cc:460] Webserver started at http://127.28.92.190:43833/ using document root <none> and password file <none>
I20260809 00:47:13.439306 13062 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:13.439394 13062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:13.439659 13062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:13.442454 13062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a"
format_stamp: "Formatted at 2026-08-09 00:47:13 on dist-test-slave-t7g5"
server_key: "f3ebc63bb3c9435d326a2ba825a9f879"
server_key_iv: "49ed399f4b7d7b71a16f1a6aaf0e1044"
server_key_version: "encryptionkey@0"
I20260809 00:47:13.443168 13062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a"
format_stamp: "Formatted at 2026-08-09 00:47:13 on dist-test-slave-t7g5"
server_key: "f3ebc63bb3c9435d326a2ba825a9f879"
server_key_iv: "49ed399f4b7d7b71a16f1a6aaf0e1044"
server_key_version: "encryptionkey@0"
I20260809 00:47:13.447966 13062 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 00:47:13.451292 13089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:13.452514 13062 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:47:13.452648 13062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a"
format_stamp: "Formatted at 2026-08-09 00:47:13 on dist-test-slave-t7g5"
server_key: "f3ebc63bb3c9435d326a2ba825a9f879"
server_key_iv: "49ed399f4b7d7b71a16f1a6aaf0e1044"
server_key_version: "encryptionkey@0"
I20260809 00:47:13.452829 13062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:13.458351 13062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:13.459053 13062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:13.459298 13062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:13.476310 13062 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:45471
I20260809 00:47:13.476342 13168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:45471 every 8 connection(s)
I20260809 00:47:13.477619 13062 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:47:13.481594 13169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:47:13.487903 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 13062
I20260809 00:47:13.488140 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:47:13.488966 29042 external_mini_cluster.cc:1428] Setting key d9c1ec1199e36977184001820f83d253
I20260809 00:47:13.493624 13169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a: Bootstrap starting.
I20260809 00:47:13.497179 13169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a: Neither blocks nor log segments found. Creating new log.
I20260809 00:47:13.497798 13174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:13.491232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52554 (local address 127.28.92.190:45471)
0809 00:47:13.492231 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:13.492243 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:13.492286 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:47:13.494010 (+ 1724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:13.494034 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:13.494426 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:13.494755 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:13.495822 (+ 1067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:13.495828 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:13.495841 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:13.495855 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:13.495933 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:13.495955 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:13.496163 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:13.496335 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 00:47:13.496757 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":343,"threads_started":1}
I20260809 00:47:13.498343 13169 log.cc:824] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a: Log is configured to *not* fsync() on all Append() calls
I20260809 00:47:13.501135 13169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a: No bootstrap required, opened a new log
I20260809 00:47:13.508844 13169 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45471 } }
I20260809 00:47:13.509207 13169 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:47:13.509302 13169 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbea13df7a2d4f018ab55cc7e91bbe7a, State: Initialized, Role: FOLLOWER
I20260809 00:47:13.509932 13169 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45471 } }
I20260809 00:47:13.510154 13169 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:47:13.510289 13169 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:47:13.510453 13169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:47:13.512828 13169 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45471 } }
I20260809 00:47:13.513375 13169 leader_election.cc:302] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbea13df7a2d4f018ab55cc7e91bbe7a; no voters:
I20260809 00:47:13.513983 13169 leader_election.cc:288] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:47:13.514097 13176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:47:13.515044 13176 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [term 1 LEADER]: Becoming Leader. State: Replica: bbea13df7a2d4f018ab55cc7e91bbe7a, State: Running, Role: LEADER
I20260809 00:47:13.515590 13176 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45471 } }
I20260809 00:47:13.515971 13169 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:47:13.518429 13178 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbea13df7a2d4f018ab55cc7e91bbe7a. Latest consensus state: current_term: 1 leader_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45471 } } }
I20260809 00:47:13.518877 13178 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [sys.catalog]: This master's current role is: LEADER
I20260809 00:47:13.519389 13177 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbea13df7a2d4f018ab55cc7e91bbe7a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45471 } } }
I20260809 00:47:13.519753 13177 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a [sys.catalog]: This master's current role is: LEADER
I20260809 00:47:13.522229 13188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:47:13.526273 13188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:47:13.534273 13188 catalog_manager.cc:1347] Generated new cluster ID: 96ff7839173c424e81c3d2286c05d66d
I20260809 00:47:13.534395 13188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:47:13.546926 13188 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:47:13.547446 13188 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:47:13.558462 13188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbea13df7a2d4f018ab55cc7e91bbe7a: Generated new TSK 0
I20260809 00:47:13.559506 13188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:47:13.572021 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45471
--builtin_ntp_servers=127.28.92.148:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 00:47:13.903107 13205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:13.903419 13205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:13.903540 13205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:13.910683 13205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:13.910799 13205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:13.910943 13205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:47:13.920149 13205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:13.921459 13205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:13.923290 13205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:13.935801 13221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:13.935833 13224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:13.935874 13219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:13.942025 13205 server_base.cc:1034] running on GCE node
I20260809 00:47:13.942628 13205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:13.943522 13205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:13.944712 13205 hybrid_clock.cc:648] HybridClock initialized: now 1786236433944658 us; error 50 us; skew 500 ppm
I20260809 00:47:13.945003 13205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:13.947147 13205 webserver.cc:460] Webserver started at http://127.28.92.129:39235/ using document root <none> and password file <none>
I20260809 00:47:13.947811 13205 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:13.947904 13205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:13.948213 13205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:13.950994 13205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "008374962d9d47a6b3bd407b5be9c706"
format_stamp: "Formatted at 2026-08-09 00:47:13 on dist-test-slave-t7g5"
server_key: "105bd916a875b711238401e00c31f7a5"
server_key_iv: "53720f7e018f075861e32972c128c2fc"
server_key_version: "encryptionkey@0"
I20260809 00:47:13.951726 13205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "008374962d9d47a6b3bd407b5be9c706"
format_stamp: "Formatted at 2026-08-09 00:47:13 on dist-test-slave-t7g5"
server_key: "105bd916a875b711238401e00c31f7a5"
server_key_iv: "53720f7e018f075861e32972c128c2fc"
server_key_version: "encryptionkey@0"
I20260809 00:47:13.956573 13205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:47:13.959820 13233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:13.961040 13205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 00:47:13.961186 13205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "008374962d9d47a6b3bd407b5be9c706"
format_stamp: "Formatted at 2026-08-09 00:47:13 on dist-test-slave-t7g5"
server_key: "105bd916a875b711238401e00c31f7a5"
server_key_iv: "53720f7e018f075861e32972c128c2fc"
server_key_version: "encryptionkey@0"
I20260809 00:47:13.961376 13205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:13.966814 13205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:13.967540 13205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:13.967775 13205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:13.968607 13205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:13.969919 13205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:13.970011 13205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:13.970115 13205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:13.970204 13205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:13.999807 13205 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:44763
I20260809 00:47:13.999825 13411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:44763 every 8 connection(s)
I20260809 00:47:14.001066 13205 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:47:14.008786 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 13205
I20260809 00:47:14.008955 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.003530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:60965 (local address 127.28.92.190:45471)
0809 00:47:14.003926 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:14.003930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:14.005081 (+ 1151us) server_negotiation.cc:407] Connection header received
0809 00:47:14.006794 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:14.006800 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:14.006865 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:14.006962 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:14.008220 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:14.008226 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:14.008231 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:14.008249 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:14.008292 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:14.008303 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:14.008417 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:14.008595 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 00:47:14.008666 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":200,"threads_started":1}
I20260809 00:47:14.008996 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:47:14.009639 29042 external_mini_cluster.cc:1428] Setting key 3a71f33c825f9d3b09ae2bca261bdd8f
I20260809 00:47:14.009914 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.004028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:45471 (local address 127.28.92.129:60965)
0809 00:47:14.004918 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:14.004961 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:14.006523 (+ 1562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:14.007209 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:14.007216 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:14.007309 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:14.007923 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:47:14.007925 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:14.007970 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:47:14.008048 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:14.008390 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:14.008402 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:14.008409 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 00:47:14.008665 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 00:47:14.008910 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":264,"threads_started":1}
I20260809 00:47:14.011544 13412 heartbeater.cc:347] Connected to a master server at 127.28.92.190:45471
I20260809 00:47:14.011843 13412 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:14.012432 13412 heartbeater.cc:511] Master 127.28.92.190:45471 requested a full tablet report, sending...
I20260809 00:47:14.012884 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45471
--builtin_ntp_servers=127.28.92.148:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 00:47:14.014740 13110 ts_manager.cc:194] Registered new tserver with Master: 008374962d9d47a6b3bd407b5be9c706 (127.28.92.129:44763)
W20260809 00:47:14.347556 13422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:14.347841 13422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:14.347975 13422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:14.355175 13422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:14.355290 13422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:14.355450 13422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:47:14.364523 13422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:14.365890 13422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:14.367741 13422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:14.380028 13437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:14.380364 13436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:14.380429 13440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:14.380986 13422 server_base.cc:1034] running on GCE node
I20260809 00:47:14.381595 13422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:14.382511 13422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:14.383709 13422 hybrid_clock.cc:648] HybridClock initialized: now 1786236434383670 us; error 29 us; skew 500 ppm
I20260809 00:47:14.384003 13422 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:14.389353 13422 webserver.cc:460] Webserver started at http://127.28.92.130:39891/ using document root <none> and password file <none>
I20260809 00:47:14.390069 13422 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:14.390172 13422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:14.390487 13422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:14.393270 13422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "79db075e317b4ed9a71cfe572d12c231"
format_stamp: "Formatted at 2026-08-09 00:47:14 on dist-test-slave-t7g5"
server_key: "f23453de19235474350b4375c11d4308"
server_key_iv: "b62fe3b35b382fd8133c9a11ef47c4bd"
server_key_version: "encryptionkey@0"
I20260809 00:47:14.394053 13422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "79db075e317b4ed9a71cfe572d12c231"
format_stamp: "Formatted at 2026-08-09 00:47:14 on dist-test-slave-t7g5"
server_key: "f23453de19235474350b4375c11d4308"
server_key_iv: "b62fe3b35b382fd8133c9a11ef47c4bd"
server_key_version: "encryptionkey@0"
I20260809 00:47:14.398862 13422 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 00:47:14.402092 13450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:14.403304 13422 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 00:47:14.403457 13422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "79db075e317b4ed9a71cfe572d12c231"
format_stamp: "Formatted at 2026-08-09 00:47:14 on dist-test-slave-t7g5"
server_key: "f23453de19235474350b4375c11d4308"
server_key_iv: "b62fe3b35b382fd8133c9a11ef47c4bd"
server_key_version: "encryptionkey@0"
I20260809 00:47:14.403657 13422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:14.409119 13422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:14.409960 13422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:14.410202 13422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:14.411062 13422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:14.412389 13422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:14.412492 13422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:14.412597 13422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:14.412667 13422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:14.442759 13422 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:41247
I20260809 00:47:14.442816 13623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:41247 every 8 connection(s)
I20260809 00:47:14.444084 13422 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:47:14.448108 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 13422
I20260809 00:47:14.448305 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:47:14.448868 29042 external_mini_cluster.cc:1428] Setting key d81e79f433097e5e1f21695feb376922
I20260809 00:47:14.451823 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45471
--builtin_ntp_servers=127.28.92.148:35275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 00:47:14.452853 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.446605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:48443 (local address 127.28.92.190:45471)
0809 00:47:14.446807 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:14.446814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:14.448319 (+ 1505us) server_negotiation.cc:407] Connection header received
0809 00:47:14.450497 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:14.450501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:14.450574 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:14.450667 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:14.452104 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:14.452110 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:14.452115 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:14.452148 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:14.452182 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:14.452194 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:14.452325 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:14.452505 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 00:47:14.452575 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:47:14.453845 13629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.447140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:45471 (local address 127.28.92.130:48443)
0809 00:47:14.448145 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:14.448201 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:14.450217 (+ 2016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:14.450931 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:14.450942 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:14.451060 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:14.451747 (+ 687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:47:14.451749 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:14.451787 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:47:14.451875 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:14.452283 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:14.452294 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:14.452302 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 00:47:14.452585 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 00:47:14.452836 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":260,"threads_started":1}
I20260809 00:47:14.455154 13625 heartbeater.cc:347] Connected to a master server at 127.28.92.190:45471
I20260809 00:47:14.455405 13625 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:14.456034 13625 heartbeater.cc:511] Master 127.28.92.190:45471 requested a full tablet report, sending...
I20260809 00:47:14.457432 13110 ts_manager.cc:194] Registered new tserver with Master: 79db075e317b4ed9a71cfe572d12c231 (127.28.92.130:41247)
W20260809 00:47:14.788020 13630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:14.788311 13630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:14.788436 13630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:14.795699 13630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:14.795828 13630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:14.795982 13630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:47:14.805126 13630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:35275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:14.806475 13630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:14.808296 13630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:14.820753 13637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:14.820865 13638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:14.821347 13641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:14.821616 13630 server_base.cc:1034] running on GCE node
I20260809 00:47:14.822252 13630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:14.823144 13630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:14.824338 13630 hybrid_clock.cc:648] HybridClock initialized: now 1786236434824285 us; error 48 us; skew 500 ppm
I20260809 00:47:14.824640 13630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:47:14.826992 13630 webserver.cc:460] Webserver started at http://127.28.92.131:34323/ using document root <none> and password file <none>
I20260809 00:47:14.827652 13630 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:14.827755 13630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:14.828065 13630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:14.830899 13630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "2ff919a60fee44378b4dd5d1a153143a"
format_stamp: "Formatted at 2026-08-09 00:47:14 on dist-test-slave-t7g5"
server_key: "01c126b80d6d9f62e79b788cf8f8cd01"
server_key_iv: "18a16dd05e6ce32c532927beb2dd0f44"
server_key_version: "encryptionkey@0"
I20260809 00:47:14.831691 13630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "2ff919a60fee44378b4dd5d1a153143a"
format_stamp: "Formatted at 2026-08-09 00:47:14 on dist-test-slave-t7g5"
server_key: "01c126b80d6d9f62e79b788cf8f8cd01"
server_key_iv: "18a16dd05e6ce32c532927beb2dd0f44"
server_key_version: "encryptionkey@0"
I20260809 00:47:14.836717 13630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:47:14.840037 13649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:14.841320 13630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:47:14.841464 13630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "2ff919a60fee44378b4dd5d1a153143a"
format_stamp: "Formatted at 2026-08-09 00:47:14 on dist-test-slave-t7g5"
server_key: "01c126b80d6d9f62e79b788cf8f8cd01"
server_key_iv: "18a16dd05e6ce32c532927beb2dd0f44"
server_key_version: "encryptionkey@0"
I20260809 00:47:14.841645 13630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:14.846966 13630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:14.847711 13630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:14.847932 13630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:14.848770 13630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:14.850143 13630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:14.850230 13630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:14.850312 13630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:14.850365 13630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:14.879396 13630 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:44563
I20260809 00:47:14.879444 13835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:44563 every 8 connection(s)
I20260809 00:47:14.880710 13630 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:47:14.886709 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 13630
I20260809 00:47:14.886926 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:47:14.887372 29042 external_mini_cluster.cc:1428] Setting key 2beb0c922747b548cdb152a6d2d2e72b
I20260809 00:47:14.888967 13418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.883286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:51893 (local address 127.28.92.190:45471)
0809 00:47:14.883462 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:14.883467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:14.884891 (+ 1424us) server_negotiation.cc:407] Connection header received
0809 00:47:14.886639 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:14.886645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:14.886724 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:14.886842 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:14.888173 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:14.888179 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:14.888183 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:14.888205 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:14.888248 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:14.888264 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:14.888365 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:14.888583 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 00:47:14.888648 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:47:14.890095 13839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.883830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:45471 (local address 127.28.92.131:51893)
0809 00:47:14.884727 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:14.884770 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:14.886359 (+ 1589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:14.887130 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:14.887138 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:14.887234 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:14.887872 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:47:14.887874 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:14.887914 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:47:14.888013 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:14.888358 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:14.888367 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:14.888374 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 00:47:14.888650 (+ 276us) client_negotiation.cc:240] Negotiation successful
0809 00:47:14.888889 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":270,"threads_started":1}
I20260809 00:47:14.891363 13837 heartbeater.cc:347] Connected to a master server at 127.28.92.190:45471
I20260809 00:47:14.891625 13837 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:14.892194 13837 heartbeater.cc:511] Master 127.28.92.190:45471 requested a full tablet report, sending...
I20260809 00:47:14.893462 13110 ts_manager.cc:194] Registered new tserver with Master: 2ff919a60fee44378b4dd5d1a153143a (127.28.92.131:44563)
I20260809 00:47:14.903041 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 00:47:14.908921 13418 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:47:14.907375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53380 (local address 127.28.92.190:45471)
0809 00:47:14.907557 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:14.907561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:14.908068 (+ 507us) server_negotiation.cc:407] Connection header received
0809 00:47:14.908208 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:14.908212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:14.908267 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:14.908345 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:14.908658 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53380: BlockingRecv error: recv got EOF from 127.0.0.1:53380 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 00:47:14.909795 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 13205
I20260809 00:47:14.913017 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:14.910729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56550 (local address 127.28.92.129:44763)
0809 00:47:14.911210 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:14.911217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:14.911245 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:47:14.911305 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:14.911311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:14.911520 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:14.911653 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:14.912439 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:14.912446 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:14.912460 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:14.912473 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:14.912519 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:14.912533 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:14.912640 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:14.912686 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 00:47:14.912770 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":222,"threads_started":1}
I20260809 00:47:14.914325 13405 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:14.994563 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 13205
I20260809 00:47:15.018303 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 13422
I20260809 00:47:15.021620 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:15.019178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.28.92.130:41247)
0809 00:47:15.019699 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:15.019706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:15.019735 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:47:15.019807 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:15.019813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:15.020058 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:15.020200 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:15.021024 (+ 824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:15.021031 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:15.021044 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:15.021057 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:15.021104 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:15.021119 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:15.021230 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:15.021290 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 00:47:15.021382 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":234,"threads_started":1}
I20260809 00:47:15.022934 13613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:15.102947 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 13422
I20260809 00:47:15.123044 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 13630
I20260809 00:47:15.126807 13861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:15.124026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58308 (local address 127.28.92.131:44563)
0809 00:47:15.124615 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:15.124623 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:15.124652 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:47:15.124715 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:15.124721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:15.124935 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:15.125069 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:15.126103 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:15.126110 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:15.126122 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:47:15.126139 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:15.126178 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:47:15.126192 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:15.126321 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:15.126372 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 00:47:15.126463 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":285,"threads_started":1}
I20260809 00:47:15.128063 13828 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:15.208191 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 13630
I20260809 00:47:15.233610 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 13062
I20260809 00:47:15.234880 13161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:15.337260 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 13062
2026-08-09T00:47:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2353 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:47:15 dist-test-slave-t7g5 krb5kdc[13871](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:47:15 dist-test-slave-t7g5 krb5kdc[13871](info): set up 2 sockets
Aug 09 00:47:15 dist-test-slave-t7g5 krb5kdc[13871](info): commencing operation
krb5kdc: starting...
W20260809 00:47:16.574415 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.004s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:47:16 dist-test-slave-t7g5 krb5kdc[13871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:47:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:47:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:47:16.840967 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:46847
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:46847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:47:17.175730 13893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:17.176041 13893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:17.176182 13893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:17.183647 13893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:47:17.183775 13893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:17.183864 13893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:17.183945 13893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:47:17.184008 13893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:47:17.193975 13893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:46847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:46847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:17.195351 13893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:17.196702 13893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:17.208092 13904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:17.208163 13908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:17.208184 13906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:17.209213 13893 server_base.cc:1034] running on GCE node
I20260809 00:47:17.210023 13893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:17.211370 13893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:17.212603 13893 hybrid_clock.cc:648] HybridClock initialized: now 1786236437212543 us; error 48 us; skew 500 ppm
I20260809 00:47:17.212929 13893 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:47:17 dist-test-slave-t7g5 krb5kdc[13871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236437, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:47:17.216048 13893 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:47:17.217543 13893 webserver.cc:460] Webserver started at http://127.28.92.190:45181/ using document root <none> and password file <none>
I20260809 00:47:17.218242 13893 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:17.218348 13893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:17.218621 13893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:17.221722 13893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "6625502593fd4a9ba30b51940ad4a260"
format_stamp: "Formatted at 2026-08-09 00:47:17 on dist-test-slave-t7g5"
server_key: "50f0342bdb1dba1461a5859f8e276b22"
server_key_iv: "0af9700020a6394f32900e6b0fa04340"
server_key_version: "encryptionkey@0"
I20260809 00:47:17.222463 13893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "6625502593fd4a9ba30b51940ad4a260"
format_stamp: "Formatted at 2026-08-09 00:47:17 on dist-test-slave-t7g5"
server_key: "50f0342bdb1dba1461a5859f8e276b22"
server_key_iv: "0af9700020a6394f32900e6b0fa04340"
server_key_version: "encryptionkey@0"
I20260809 00:47:17.227635 13893 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:47:17.231011 13922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:17.232290 13893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:47:17.232465 13893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "6625502593fd4a9ba30b51940ad4a260"
format_stamp: "Formatted at 2026-08-09 00:47:17 on dist-test-slave-t7g5"
server_key: "50f0342bdb1dba1461a5859f8e276b22"
server_key_iv: "0af9700020a6394f32900e6b0fa04340"
server_key_version: "encryptionkey@0"
I20260809 00:47:17.232652 13893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:17.255293 13893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:17.259204 13893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:17.259478 13893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:17.276513 13893 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:46847
I20260809 00:47:17.276557 14007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:46847 every 8 connection(s)
I20260809 00:47:17.277828 13893 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:47:17.281448 14010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:47:17.286128 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 13893
I20260809 00:47:17.286366 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:47:17.287220 29042 external_mini_cluster.cc:1428] Setting key 7ada1e01f137903e4b8fafb5a40d4108
I20260809 00:47:17.293179 14010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260: Bootstrap starting.
I20260809 00:47:17.296820 14010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260: Neither blocks nor log segments found. Creating new log.
I20260809 00:47:17.298048 14010 log.cc:824] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260: Log is configured to *not* fsync() on all Append() calls
I20260809 00:47:17.301411 14010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260: No bootstrap required, opened a new log
Aug 09 00:47:17 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:47:17.311362 14013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:17.289321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49940 (local address 127.28.92.190:46847)
0809 00:47:17.290069 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:17.290084 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:17.290127 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:47:17.291840 (+ 1713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:17.291863 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:17.292232 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:17.292551 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:17.294452 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:17.295754 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:17.297523 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:17.298248 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:17.298381 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:17.302950 (+ 4569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:17.302963 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:17.302987 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:17.303037 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:17.306984 (+ 3947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:17.307633 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:17.307643 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:17.307652 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:17.307871 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:17.308189 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:17.308194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:17.308198 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:17.308914 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:17.309225 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:17.309516 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 00:47:17.310008 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":328,"threads_started":1}
I20260809 00:47:17.311870 14010 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6625502593fd4a9ba30b51940ad4a260" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46847 } }
I20260809 00:47:17.312254 14010 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:47:17.312350 14010 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6625502593fd4a9ba30b51940ad4a260, State: Initialized, Role: FOLLOWER
I20260809 00:47:17.312964 14010 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6625502593fd4a9ba30b51940ad4a260" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46847 } }
I20260809 00:47:17.313194 14010 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:47:17.313338 14010 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:47:17.313508 14010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:47:17.315692 14010 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6625502593fd4a9ba30b51940ad4a260" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46847 } }
I20260809 00:47:17.316164 14010 leader_election.cc:302] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6625502593fd4a9ba30b51940ad4a260; no voters:
I20260809 00:47:17.316712 14010 leader_election.cc:288] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:47:17.316818 14015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:47:17.317447 14015 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [term 1 LEADER]: Becoming Leader. State: Replica: 6625502593fd4a9ba30b51940ad4a260, State: Running, Role: LEADER
I20260809 00:47:17.317976 14015 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6625502593fd4a9ba30b51940ad4a260" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46847 } }
I20260809 00:47:17.318763 14010 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:47:17.320886 14017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6625502593fd4a9ba30b51940ad4a260. Latest consensus state: current_term: 1 leader_uuid: "6625502593fd4a9ba30b51940ad4a260" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6625502593fd4a9ba30b51940ad4a260" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46847 } } }
I20260809 00:47:17.320950 14016 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6625502593fd4a9ba30b51940ad4a260" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6625502593fd4a9ba30b51940ad4a260" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 46847 } } }
I20260809 00:47:17.321252 14017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [sys.catalog]: This master's current role is: LEADER
I20260809 00:47:17.321313 14016 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260 [sys.catalog]: This master's current role is: LEADER
I20260809 00:47:17.322193 14023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:47:17.327962 14023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:47:17.336995 14023 catalog_manager.cc:1347] Generated new cluster ID: 336f2feb823841749297b3fef492ca7c
I20260809 00:47:17.337129 14023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:47:17.357146 14023 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:47:17.358989 14023 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:47:17.365378 14023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260: Generated new TSK 0
I20260809 00:47:17.366137 14023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:47:17.439524 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:46847
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:47:17.771896 14053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:17.772173 14053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:17.772310 14053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:17.779505 14053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:17.779610 14053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:17.779759 14053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:47:17.789561 14053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:46847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:17.790889 14053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:17.792174 14053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:17.804665 14061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:17.804708 14062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:17.804729 14072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:17.805927 14053 server_base.cc:1034] running on GCE node
I20260809 00:47:17.806520 14053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:17.807401 14053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:17.808593 14053 hybrid_clock.cc:648] HybridClock initialized: now 1786236437808552 us; error 38 us; skew 500 ppm
I20260809 00:47:17.808882 14053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:47:17 dist-test-slave-t7g5 krb5kdc[13871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236437, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:47:17.812044 14053 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:47:17.813455 14053 webserver.cc:460] Webserver started at http://127.28.92.129:35977/ using document root <none> and password file <none>
I20260809 00:47:17.814162 14053 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:17.814262 14053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:17.814527 14053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:17.817299 14053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "5fb4223742d04ce1805ba708378e2a1e"
format_stamp: "Formatted at 2026-08-09 00:47:17 on dist-test-slave-t7g5"
server_key: "3b8674c496bec76cdd62a742c6ca68e8"
server_key_iv: "73a47d39b500e28ffdc528308cc61ebe"
server_key_version: "encryptionkey@0"
I20260809 00:47:17.818046 14053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "5fb4223742d04ce1805ba708378e2a1e"
format_stamp: "Formatted at 2026-08-09 00:47:17 on dist-test-slave-t7g5"
server_key: "3b8674c496bec76cdd62a742c6ca68e8"
server_key_iv: "73a47d39b500e28ffdc528308cc61ebe"
server_key_version: "encryptionkey@0"
I20260809 00:47:17.822994 14053 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 00:47:17.826277 14082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:17.827518 14053 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:47:17.827666 14053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "5fb4223742d04ce1805ba708378e2a1e"
format_stamp: "Formatted at 2026-08-09 00:47:17 on dist-test-slave-t7g5"
server_key: "3b8674c496bec76cdd62a742c6ca68e8"
server_key_iv: "73a47d39b500e28ffdc528308cc61ebe"
server_key_version: "encryptionkey@0"
I20260809 00:47:17.827848 14053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:17.870153 14053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:17.874281 14053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:17.874589 14053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:17.875587 14053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:17.876952 14053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:17.877029 14053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:17.877153 14053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:17.877208 14053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:17.909287 14053 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:33019
I20260809 00:47:17.909330 14252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:33019 every 8 connection(s)
I20260809 00:47:17.910547 14053 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:47:17.918774 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 14053
I20260809 00:47:17.919027 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:47:17.919660 29042 external_mini_cluster.cc:1428] Setting key 11ac5eeebc94ed46f7488d68ece042c2
Aug 09 00:47:17 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236437, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:47:17.930881 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:17.912945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:45477 (local address 127.28.92.190:46847)
0809 00:47:17.913358 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:17.913363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:17.914376 (+ 1013us) server_negotiation.cc:407] Connection header received
0809 00:47:17.916180 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:17.916185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:17.916256 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:17.916353 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:17.917787 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:17.918657 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:17.920448 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:17.920865 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:17.920970 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:17.925001 (+ 4031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:17.925007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:17.925011 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:17.925047 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:17.927596 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:17.928449 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:17.928454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:17.928456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:17.928575 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:17.929020 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:17.929023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:17.929025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:17.929285 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:17.929395 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:17.930336 (+ 941us) server_negotiation.cc:299] Negotiation successful
0809 00:47:17.930557 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":194,"threads_started":1}
I20260809 00:47:17.932334 14257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:17.913512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:46847 (local address 127.28.92.129:45477)
0809 00:47:17.914218 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:17.914254 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:17.915880 (+ 1626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:17.916547 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:17.916555 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:17.917062 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:17.917611 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:17.917630 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:17.918791 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:17.918795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:17.920297 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:17.920309 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:17.921085 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:17.921092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:17.921369 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:17.922063 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:17.922087 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:17.924739 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:17.927744 (+ 3005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:47:17.927753 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:47:17.927772 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:47:17.928334 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:47:17.928666 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:47:17.928671 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:47:17.928674 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:47:17.928920 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:47:17.929400 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:17.929408 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:17.929897 (+ 489us) client_negotiation.cc:769] Sending connection context
0809 00:47:17.930209 (+ 312us) client_negotiation.cc:240] Negotiation successful
0809 00:47:17.930821 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":280,"threads_started":1}
I20260809 00:47:17.933913 14253 heartbeater.cc:347] Connected to a master server at 127.28.92.190:46847
I20260809 00:47:17.934213 14253 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:17.934952 14253 heartbeater.cc:511] Master 127.28.92.190:46847 requested a full tablet report, sending...
I20260809 00:47:17.937212 13952 ts_manager.cc:194] Registered new tserver with Master: 5fb4223742d04ce1805ba708378e2a1e (127.28.92.129:33019)
I20260809 00:47:17.938750 13952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:45477
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:47:17.978500 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:46847
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:47:18.312161 14261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:18.312470 14261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:18.312608 14261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:18.319927 14261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:18.320065 14261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:18.320222 14261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:47:18.330179 14261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:46847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:18.331540 14261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:18.332894 14261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:18.346239 14271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:18.346201 14276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:18.346170 14274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:18.347015 14261 server_base.cc:1034] running on GCE node
I20260809 00:47:18.347688 14261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:18.348655 14261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:18.349850 14261 hybrid_clock.cc:648] HybridClock initialized: now 1786236438349799 us; error 52 us; skew 500 ppm
I20260809 00:47:18.350163 14261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:47:18 dist-test-slave-t7g5 krb5kdc[13871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236438, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:47:18.353179 14261 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:47:18.354681 14261 webserver.cc:460] Webserver started at http://127.28.92.130:34171/ using document root <none> and password file <none>
I20260809 00:47:18.355368 14261 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:18.355494 14261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:18.355756 14261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:18.358700 14261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "84bb0b482779497faf2b17582df0fa06"
format_stamp: "Formatted at 2026-08-09 00:47:18 on dist-test-slave-t7g5"
server_key: "3d48f7add7ec5907c8885658c1c68049"
server_key_iv: "51c4293198fc48e20208968bd12549b2"
server_key_version: "encryptionkey@0"
I20260809 00:47:18.359377 14261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "84bb0b482779497faf2b17582df0fa06"
format_stamp: "Formatted at 2026-08-09 00:47:18 on dist-test-slave-t7g5"
server_key: "3d48f7add7ec5907c8885658c1c68049"
server_key_iv: "51c4293198fc48e20208968bd12549b2"
server_key_version: "encryptionkey@0"
I20260809 00:47:18.364310 14261 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:47:18.367583 14284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:18.368772 14261 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 00:47:18.368904 14261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "84bb0b482779497faf2b17582df0fa06"
format_stamp: "Formatted at 2026-08-09 00:47:18 on dist-test-slave-t7g5"
server_key: "3d48f7add7ec5907c8885658c1c68049"
server_key_iv: "51c4293198fc48e20208968bd12549b2"
server_key_version: "encryptionkey@0"
I20260809 00:47:18.369064 14261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:18.381644 14261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:18.385130 14261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:18.385375 14261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:18.386304 14261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:18.387529 14261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:18.387601 14261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:18.387691 14261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:18.387741 14261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:18.417372 14261 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:42569
I20260809 00:47:18.417409 14449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:42569 every 8 connection(s)
I20260809 00:47:18.418663 14261 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:47:18.423830 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 14261
I20260809 00:47:18.424029 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:47:18.424641 29042 external_mini_cluster.cc:1428] Setting key 1762dd87fdc6732de2a27c72ebecaa63
Aug 09 00:47:18 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236438, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:47:18.439082 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.421173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:44351 (local address 127.28.92.190:46847)
0809 00:47:18.421337 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:18.421341 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:18.422493 (+ 1152us) server_negotiation.cc:407] Connection header received
0809 00:47:18.424645 (+ 2152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:18.424650 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:18.424735 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:18.424841 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:18.426610 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.427302 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.428811 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.429231 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.429341 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:18.433197 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:18.433203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:18.433208 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:18.433247 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:18.435803 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:18.436665 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:18.436670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:18.436672 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:18.436803 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:18.437266 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:18.437270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:18.437273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:18.437674 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:18.437819 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:18.438531 (+ 712us) server_negotiation.cc:299] Negotiation successful
0809 00:47:18.438769 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 00:47:18.439878 14454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.421597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:46847 (local address 127.28.92.130:44351)
0809 00:47:18.422328 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:18.422365 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:18.424344 (+ 1979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:18.425121 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:18.425130 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:18.425826 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:18.426442 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:18.426468 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.427453 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.427459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:18.428673 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:18.428685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.429444 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.429453 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:18.429726 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:18.430354 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:18.430377 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:18.432920 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:18.435960 (+ 3040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:47:18.435970 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:47:18.435987 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:47:18.436548 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:47:18.436902 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:47:18.436907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:47:18.436910 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:47:18.437164 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:47:18.437791 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:18.437797 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:18.438143 (+ 346us) client_negotiation.cc:769] Sending connection context
0809 00:47:18.438368 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 00:47:18.438767 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":267,"threads_started":1}
I20260809 00:47:18.441304 14452 heartbeater.cc:347] Connected to a master server at 127.28.92.190:46847
I20260809 00:47:18.441679 14452 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:18.442615 14452 heartbeater.cc:511] Master 127.28.92.190:46847 requested a full tablet report, sending...
I20260809 00:47:18.444206 13952 ts_manager.cc:194] Registered new tserver with Master: 84bb0b482779497faf2b17582df0fa06 (127.28.92.130:42569)
I20260809 00:47:18.445021 13952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:44351
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:47:18.484457 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:46847
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:45839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:47:18.810292 14458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:47:18.810595 14458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:47:18.810735 14458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:47:18.818087 14458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:47:18.818220 14458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:47:18.818370 14458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:47:18.828348 14458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:45839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:46847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:47:18.829699 14458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:47:18.831079 14458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:47:18.843454 14467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:18.843487 14469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:47:18.843400 14471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:47:18.844424 14458 server_base.cc:1034] running on GCE node
I20260809 00:47:18.844993 14458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:47:18.845892 14458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:47:18.847078 14458 hybrid_clock.cc:648] HybridClock initialized: now 1786236438847029 us; error 44 us; skew 500 ppm
I20260809 00:47:18.847375 14458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:47:18 dist-test-slave-t7g5 krb5kdc[13871](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236438, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:47:18.850287 14458 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:47:18.851605 14458 webserver.cc:460] Webserver started at http://127.28.92.131:45427/ using document root <none> and password file <none>
I20260809 00:47:18.852267 14458 fs_manager.cc:359] Metadata directory not provided
I20260809 00:47:18.852382 14458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:47:18.852659 14458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:47:18.855489 14458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "0137616138684f60aeb78578fb280059"
format_stamp: "Formatted at 2026-08-09 00:47:18 on dist-test-slave-t7g5"
server_key: "9ba72394d1c4a0fabd96c0444d427f4c"
server_key_iv: "25a9851b8f927fef701d882e5ee98170"
server_key_version: "encryptionkey@0"
I20260809 00:47:18.856217 14458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "0137616138684f60aeb78578fb280059"
format_stamp: "Formatted at 2026-08-09 00:47:18 on dist-test-slave-t7g5"
server_key: "9ba72394d1c4a0fabd96c0444d427f4c"
server_key_iv: "25a9851b8f927fef701d882e5ee98170"
server_key_version: "encryptionkey@0"
I20260809 00:47:18.860939 14458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260809 00:47:18.864202 14480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:18.865419 14458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 00:47:18.865564 14458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "0137616138684f60aeb78578fb280059"
format_stamp: "Formatted at 2026-08-09 00:47:18 on dist-test-slave-t7g5"
server_key: "9ba72394d1c4a0fabd96c0444d427f4c"
server_key_iv: "25a9851b8f927fef701d882e5ee98170"
server_key_version: "encryptionkey@0"
I20260809 00:47:18.865780 14458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:47:18.882690 14458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:47:18.886482 14458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:47:18.886754 14458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:47:18.887676 14458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:47:18.888986 14458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:47:18.889071 14458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:18.889191 14458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:47:18.889245 14458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:47:18.920014 14458 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:33335
I20260809 00:47:18.920051 14673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:33335 every 8 connection(s)
I20260809 00:47:18.921346 14458 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:47:18.928973 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 14458
I20260809 00:47:18.929176 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:47:18.929711 29042 external_mini_cluster.cc:1428] Setting key b18d09befbee8ad097bcea6e67685566
Aug 09 00:47:18 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236438, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:47:18.940511 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.923874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:43303 (local address 127.28.92.190:46847)
0809 00:47:18.924051 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:18.924055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:18.925209 (+ 1154us) server_negotiation.cc:407] Connection header received
0809 00:47:18.927047 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:18.927052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:18.927126 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:18.927214 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:18.928577 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.929644 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.931455 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.931947 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.932045 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:18.935559 (+ 3514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:18.935564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:18.935567 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:18.935600 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:18.938050 (+ 2450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:18.938702 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:18.938706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:18.938708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:18.938823 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:18.939155 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:18.939158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:18.939160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:18.939410 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:18.939523 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:18.940090 (+ 567us) server_negotiation.cc:299] Negotiation successful
0809 00:47:18.940248 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 00:47:18.941587 14678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.924338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:46847 (local address 127.28.92.131:43303)
0809 00:47:18.925044 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:18.925098 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:18.926757 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:18.927402 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:18.927409 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:18.927887 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:47:18.928435 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:18.928454 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.929821 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.929827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:18.931311 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:18.931324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.932196 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.932205 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:18.932536 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:18.933178 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:47:18.933200 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:47:18.935360 (+ 2160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:47:18.938177 (+ 2817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:47:18.938184 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:47:18.938197 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:47:18.938620 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:47:18.938898 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:47:18.938901 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:47:18.938904 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:47:18.939080 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:47:18.939504 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:47:18.939509 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:47:18.939804 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 00:47:18.940025 (+ 221us) client_negotiation.cc:240] Negotiation successful
0809 00:47:18.940393 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":265,"threads_started":1}
I20260809 00:47:18.942123 14253 heartbeater.cc:503] Master 127.28.92.190:46847 was elected leader, sending a full tablet report...
I20260809 00:47:18.943102 14674 heartbeater.cc:347] Connected to a master server at 127.28.92.190:46847
I20260809 00:47:18.943432 14674 heartbeater.cc:464] Registering TS with master...
I20260809 00:47:18.944234 14674 heartbeater.cc:511] Master 127.28.92.190:46847 requested a full tablet report, sending...
I20260809 00:47:18.945531 13952 ts_manager.cc:194] Registered new tserver with Master: 0137616138684f60aeb78578fb280059 (127.28.92.131:33335)
I20260809 00:47:18.946327 13952 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:43303
I20260809 00:47:18.957154 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:47:18.973722 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.961552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49956 (local address 127.28.92.190:46847)
0809 00:47:18.961805 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:18.961812 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:18.962172 (+ 360us) server_negotiation.cc:407] Connection header received
0809 00:47:18.962321 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:18.962325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:18.962390 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:18.962463 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:18.963823 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.964876 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.966132 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:18.966544 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:18.966639 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:18.968836 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:18.968841 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:18.968844 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:18.968878 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:18.971329 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:18.971916 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:18.971921 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:18.971924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:18.972081 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:18.972385 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:18.972388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:18.972390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:18.972705 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:18.972886 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:18.973210 (+ 324us) server_negotiation.cc:299] Negotiation successful
0809 00:47:18.973370 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 00:47:18.977562 13952 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49956:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:47:18.984550 13952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:47:19.008005 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.996525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:42569 (local address 127.0.0.1:33424)
0809 00:47:18.997963 (+ 1438us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:18.998008 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:18.998208 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:18.999037 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:18.999048 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:18.999080 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:47:18.999540 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:18.999556 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.001596 (+ 2040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.001603 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.004326 (+ 2723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.004346 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.006820 (+ 2474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.006827 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.007083 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.007138 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 00:47:19.007297 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 00:47:19.007530 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1175,"thread_start_us":2290,"threads_started":1}
I20260809 00:47:19.009012 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.996625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33424 (local address 127.28.92.130:42569)
0809 00:47:18.997372 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:18.997383 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:18.998412 (+ 1029us) server_negotiation.cc:407] Connection header received
0809 00:47:18.998541 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:18.998549 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:18.998811 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:18.999009 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:47:18.999752 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.001404 (+ 1652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.004571 (+ 3167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.006289 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.006439 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.006669 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.008452 (+ 1783us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.008666 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":823,"threads_started":1}
I20260809 00:47:19.009284 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.997262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44760 (local address 127.28.92.129:33019)
0809 00:47:18.998793 (+ 1531us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:18.998801 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:18.999271 (+ 470us) server_negotiation.cc:407] Connection header received
0809 00:47:18.999380 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:18.999387 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:18.999639 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:18.999834 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:47:19.000847 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.002658 (+ 1811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.005439 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.007060 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.007205 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.007463 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.008687 (+ 1224us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.008890 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1356,"thread_start_us":1109,"threads_started":1}
I20260809 00:47:19.008533 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.996718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44760)
0809 00:47:18.999065 (+ 2347us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:18.999082 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:18.999212 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:19.000104 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:19.000109 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:19.000138 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:47:19.000608 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.000620 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.002837 (+ 2217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.002844 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.005216 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.005236 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.007636 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.007643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.007856 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.007893 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:47:19.007989 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 00:47:19.008138 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2220,"thread_start_us":830,"threads_started":1}
I20260809 00:47:19.014101 14162 tablet_service.cc:1467] Processing CreateTablet for tablet 295d20e79f8f47d9bb721c4e55c2d644 (DEFAULT_TABLE table=test-table [id=2a6bdd71048e4530816207c762895ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:47:19.014243 14354 tablet_service.cc:1467] Processing CreateTablet for tablet 295d20e79f8f47d9bb721c4e55c2d644 (DEFAULT_TABLE table=test-table [id=2a6bdd71048e4530816207c762895ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:47:19.015801 14162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 295d20e79f8f47d9bb721c4e55c2d644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:47:19.015825 14354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 295d20e79f8f47d9bb721c4e55c2d644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:47:19.018231 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.999442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:33335 (local address 127.0.0.1:38704)
0809 00:47:19.009497 (+ 10055us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.009521 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:19.009641 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:19.011186 (+ 1545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:19.011191 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:19.011219 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:47:19.011402 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.011413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.013530 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.013535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.015672 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.015688 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.017449 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.017455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.017630 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.017693 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 00:47:19.017793 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 00:47:19.017938 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9935,"thread_start_us":11076,"threads_started":1}
I20260809 00:47:19.018965 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:18.999585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38704 (local address 127.28.92.131:33335)
0809 00:47:19.010541 (+ 10956us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.010549 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.010585 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:47:19.010689 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.010697 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.010961 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.011560 (+ 599us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:47:19.011777 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.013359 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.015854 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.017253 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.017398 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.017628 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.017851 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.018631 (+ 780us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10776,"thread_start_us":10601,"threads_started":1}
I20260809 00:47:19.023100 14560 tablet_service.cc:1467] Processing CreateTablet for tablet 295d20e79f8f47d9bb721c4e55c2d644 (DEFAULT_TABLE table=test-table [id=2a6bdd71048e4530816207c762895ae3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:47:19.024722 14560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 295d20e79f8f47d9bb721c4e55c2d644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:47:19.029857 14707 tablet_bootstrap.cc:492] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Bootstrap starting.
I20260809 00:47:19.031843 14706 tablet_bootstrap.cc:492] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Bootstrap starting.
I20260809 00:47:19.033699 14707 tablet_bootstrap.cc:654] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Neither blocks nor log segments found. Creating new log.
I20260809 00:47:19.035247 14707 log.cc:824] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Log is configured to *not* fsync() on all Append() calls
I20260809 00:47:19.035358 14706 tablet_bootstrap.cc:654] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Neither blocks nor log segments found. Creating new log.
I20260809 00:47:19.036573 14706 log.cc:824] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:47:19.038256 14707 tablet_bootstrap.cc:492] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: No bootstrap required, opened a new log
I20260809 00:47:19.038513 14707 ts_tablet_manager.cc:1397] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 00:47:19.039225 14711 tablet_bootstrap.cc:492] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Bootstrap starting.
I20260809 00:47:19.040087 14706 tablet_bootstrap.cc:492] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: No bootstrap required, opened a new log
I20260809 00:47:19.040333 14706 ts_tablet_manager.cc:1397] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 00:47:19.042738 14711 tablet_bootstrap.cc:654] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Neither blocks nor log segments found. Creating new log.
I20260809 00:47:19.043959 14711 log.cc:824] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Log is configured to *not* fsync() on all Append() calls
I20260809 00:47:19.047022 14711 tablet_bootstrap.cc:492] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: No bootstrap required, opened a new log
I20260809 00:47:19.047295 14711 ts_tablet_manager.cc:1397] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 00:47:19.047899 14706 raft_consensus.cc:348] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.048241 14706 raft_consensus.cc:374] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:47:19.048377 14706 raft_consensus.cc:729] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb4223742d04ce1805ba708378e2a1e, State: Initialized, Role: FOLLOWER
I20260809 00:47:19.048945 14706 consensus_queue.cc:260] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.049165 14707 raft_consensus.cc:348] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.049676 14707 raft_consensus.cc:374] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:47:19.049819 14707 raft_consensus.cc:729] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84bb0b482779497faf2b17582df0fa06, State: Initialized, Role: FOLLOWER
I20260809 00:47:19.050518 14707 consensus_queue.cc:260] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.052196 14706 ts_tablet_manager.cc:1428] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260809 00:47:19.053198 14452 heartbeater.cc:503] Master 127.28.92.190:46847 was elected leader, sending a full tablet report...
I20260809 00:47:19.053799 14707 ts_tablet_manager.cc:1428] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260809 00:47:19.057276 14711 raft_consensus.cc:348] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.057690 14711 raft_consensus.cc:374] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:47:19.057793 14711 raft_consensus.cc:729] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0137616138684f60aeb78578fb280059, State: Initialized, Role: FOLLOWER
I20260809 00:47:19.058363 14711 consensus_queue.cc:260] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.059355 14674 heartbeater.cc:503] Master 127.28.92.190:46847 was elected leader, sending a full tablet report...
I20260809 00:47:19.060024 14711 ts_tablet_manager.cc:1428] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 00:47:19.122771 14716 raft_consensus.cc:482] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:47:19.123091 14716 raft_consensus.cc:504] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.124979 14716 leader_election.cc:288] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5fb4223742d04ce1805ba708378e2a1e (127.28.92.129:33019), 0137616138684f60aeb78578fb280059 (127.28.92.131:33335)
I20260809 00:47:19.131585 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.125329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:50217 (local address 127.28.92.129:33019)
0809 00:47:19.125574 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.125582 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.126312 (+ 730us) server_negotiation.cc:407] Connection header received
0809 00:47:19.126520 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.126524 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.126588 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.126668 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:47:19.127200 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.127934 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.129836 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.130633 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.130793 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.130874 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.131211 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.131341 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:47:19.131724 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.125717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:42373 (local address 127.28.92.131:33335)
0809 00:47:19.125924 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.125931 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.126592 (+ 661us) server_negotiation.cc:407] Connection header received
0809 00:47:19.126748 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.126751 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.126812 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.126887 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:47:19.127498 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.128228 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.129938 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.130761 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.130933 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.131008 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.131329 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.131467 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 00:47:19.131809 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.125318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.28.92.130:50217)
0809 00:47:19.126177 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.126196 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:19.126369 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:19.126701 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:19.126705 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:19.126732 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:47:19.127042 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.127052 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.128078 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.128082 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.129633 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.129647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.130844 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.130851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.131013 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.131071 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 00:47:19.131165 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 00:47:19.131299 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":21,"thread_start_us":491,"threads_started":1}
I20260809 00:47:19.131830 14723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.125480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:33335 (local address 127.28.92.130:42373)
0809 00:47:19.126467 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.126482 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:47:19.126617 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:47:19.126929 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:47:19.126934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:47:19.126973 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:47:19.127335 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.127345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.128373 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.128377 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.129780 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:47:19.129794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.131017 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.131024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:47:19.131181 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.131205 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:47:19.131282 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 00:47:19.131406 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"thread_start_us":644,"threads_started":1}
I20260809 00:47:19.132942 14596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295d20e79f8f47d9bb721c4e55c2d644" candidate_uuid: "84bb0b482779497faf2b17582df0fa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0137616138684f60aeb78578fb280059" is_pre_election: true
I20260809 00:47:19.132967 14189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295d20e79f8f47d9bb721c4e55c2d644" candidate_uuid: "84bb0b482779497faf2b17582df0fa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb4223742d04ce1805ba708378e2a1e" is_pre_election: true
I20260809 00:47:19.133553 14596 raft_consensus.cc:2454] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84bb0b482779497faf2b17582df0fa06 in term 0.
I20260809 00:47:19.133571 14189 raft_consensus.cc:2454] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84bb0b482779497faf2b17582df0fa06 in term 0.
I20260809 00:47:19.134291 14286 leader_election.cc:302] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0137616138684f60aeb78578fb280059, 84bb0b482779497faf2b17582df0fa06; no voters:
I20260809 00:47:19.134757 14716 raft_consensus.cc:2781] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:47:19.134917 14716 raft_consensus.cc:482] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:47:19.135030 14716 raft_consensus.cc:3037] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:47:19.137290 14716 raft_consensus.cc:504] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.137898 14716 leader_election.cc:288] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [CANDIDATE]: Term 1 election: Requested vote from peers 5fb4223742d04ce1805ba708378e2a1e (127.28.92.129:33019), 0137616138684f60aeb78578fb280059 (127.28.92.131:33335)
I20260809 00:47:19.138388 14596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295d20e79f8f47d9bb721c4e55c2d644" candidate_uuid: "84bb0b482779497faf2b17582df0fa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0137616138684f60aeb78578fb280059"
I20260809 00:47:19.138388 14189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "295d20e79f8f47d9bb721c4e55c2d644" candidate_uuid: "84bb0b482779497faf2b17582df0fa06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb4223742d04ce1805ba708378e2a1e"
I20260809 00:47:19.138612 14189 raft_consensus.cc:3037] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:47:19.138612 14596 raft_consensus.cc:3037] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:47:19.141851 14189 raft_consensus.cc:2454] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84bb0b482779497faf2b17582df0fa06 in term 1.
I20260809 00:47:19.141851 14596 raft_consensus.cc:2454] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84bb0b482779497faf2b17582df0fa06 in term 1.
I20260809 00:47:19.142287 14285 leader_election.cc:302] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb4223742d04ce1805ba708378e2a1e, 84bb0b482779497faf2b17582df0fa06; no voters:
I20260809 00:47:19.142599 14716 raft_consensus.cc:2781] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:47:19.143034 14716 raft_consensus.cc:686] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 1 LEADER]: Becoming Leader. State: Replica: 84bb0b482779497faf2b17582df0fa06, State: Running, Role: LEADER
I20260809 00:47:19.143555 14716 consensus_queue.cc:237] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } }
I20260809 00:47:19.148026 13949 catalog_manager.cc:5495] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84bb0b482779497faf2b17582df0fa06 (127.28.92.130). New cstate: current_term: 1 leader_uuid: "84bb0b482779497faf2b17582df0fa06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb0b482779497faf2b17582df0fa06" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 42569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 } health_report { overall_health: UNKNOWN } } }
W20260809 00:47:19.162844 14254 tablet.cc:2369] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:47:19.170573 14453 tablet.cc:2369] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:47:19.172935 14675 tablet.cc:2369] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:47:19.176736 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.171072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.28.92.130:42569)
0809 00:47:19.171280 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.171286 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.171500 (+ 214us) server_negotiation.cc:407] Connection header received
0809 00:47:19.171725 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.171729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.171807 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.171938 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:47:19.172346 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.173402 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.174790 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.175242 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.175345 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.175792 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:47:19.176299 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:47:19.176413 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.176461 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.176532 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 00:47:19.185045 14596 raft_consensus.cc:1261] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 1 FOLLOWER]: Refusing update from remote peer 84bb0b482779497faf2b17582df0fa06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:47:19.185046 14189 raft_consensus.cc:1261] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 1 FOLLOWER]: Refusing update from remote peer 84bb0b482779497faf2b17582df0fa06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:47:19.186118 14727 consensus_queue.cc:1035] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0137616138684f60aeb78578fb280059" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 33335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:47:19.186487 14716 consensus_queue.cc:1035] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb4223742d04ce1805ba708378e2a1e" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:47:19.198431 14730 mvcc.cc:205] Tried to move back new op lower bound from 7316424454891941888 to 7316424454735818752. Current Snapshot: MvccSnapshot[applied={T|T < 7316424454891941888}]
I20260809 00:47:19.212741 13952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:47:19.213069 13952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49956:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:47:19.216831 13952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6625502593fd4a9ba30b51940ad4a260: Sending DeleteTablet for 3 replicas of tablet 295d20e79f8f47d9bb721c4e55c2d644
I20260809 00:47:19.218130 14354 tablet_service.cc:1514] Processing DeleteTablet for tablet 295d20e79f8f47d9bb721c4e55c2d644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:47:19 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:33424
I20260809 00:47:19.218146 14162 tablet_service.cc:1514] Processing DeleteTablet for tablet 295d20e79f8f47d9bb721c4e55c2d644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:47:19 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:44760
I20260809 00:47:19.218354 14560 tablet_service.cc:1514] Processing DeleteTablet for tablet 295d20e79f8f47d9bb721c4e55c2d644 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:47:19 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38704
I20260809 00:47:19.220793 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 14053
I20260809 00:47:19.228296 14744 tablet_replica.cc:330] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: stopping tablet replica
I20260809 00:47:19.228813 14744 raft_consensus.cc:2229] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:47:19.229419 14744 raft_consensus.cc:2258] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:47:19.234411 14744 ts_tablet_manager.cc:1905] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:47:19.241011 14743 tablet_replica.cc:330] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: stopping tablet replica
I20260809 00:47:19.243167 14743 raft_consensus.cc:2229] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:47:19.245570 14744 ts_tablet_manager.cc:1918] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:47:19.245826 14744 log.cc:1196] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/295d20e79f8f47d9bb721c4e55c2d644
I20260809 00:47:19.246371 14744 ts_tablet_manager.cc:1939] T 295d20e79f8f47d9bb721c4e55c2d644 P 0137616138684f60aeb78578fb280059: Deleting consensus metadata
I20260809 00:47:19.246611 14743 raft_consensus.cc:2258] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:47:19.248306 13924 catalog_manager.cc:4841] TS 0137616138684f60aeb78578fb280059 (127.28.92.131:33335): tablet 295d20e79f8f47d9bb721c4e55c2d644 (table test-table [id=2a6bdd71048e4530816207c762895ae3]) successfully deleted
I20260809 00:47:19.249003 14742 tablet_replica.cc:330] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: stopping tablet replica
Aug 09 00:47:19 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:47:19.249423 14742 raft_consensus.cc:2229] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:47:19.249975 14742 raft_consensus.cc:2258] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:47:19.249969 14743 ts_tablet_manager.cc:1905] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:47:19.252173 14742 ts_tablet_manager.cc:1905] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:47:19.257380 14743 ts_tablet_manager.cc:1918] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:47:19.257619 14743 log.cc:1196] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/295d20e79f8f47d9bb721c4e55c2d644
I20260809 00:47:19.258225 14743 ts_tablet_manager.cc:1939] T 295d20e79f8f47d9bb721c4e55c2d644 P 84bb0b482779497faf2b17582df0fa06: Deleting consensus metadata
I20260809 00:47:19.258373 14702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.222161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44764 (local address 127.28.92.129:33019)
0809 00:47:19.222340 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.222346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.234433 (+ 12087us) server_negotiation.cc:407] Connection header received
0809 00:47:19.235023 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.235029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.235117 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.235205 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:19.237252 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.238591 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.241226 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.241905 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.242002 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.250744 (+ 8742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:19.250756 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:19.250772 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:19.250822 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:19.254712 (+ 3890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:19.255589 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:19.255598 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:19.255601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:19.255778 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:19.256296 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:19.256301 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:19.256305 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:19.256760 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:19.257071 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.257715 (+ 644us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.257971 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:47:19.259332 14742 ts_tablet_manager.cc:1918] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:47:19.259514 14742 log.cc:1196] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/295d20e79f8f47d9bb721c4e55c2d644
I20260809 00:47:19.259819 14248 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:19.260514 13924 catalog_manager.cc:4841] TS 84bb0b482779497faf2b17582df0fa06 (127.28.92.130:42569): tablet 295d20e79f8f47d9bb721c4e55c2d644 (table test-table [id=2a6bdd71048e4530816207c762895ae3]) successfully deleted
I20260809 00:47:19.360116 14742 ts_tablet_manager.cc:1939] T 295d20e79f8f47d9bb721c4e55c2d644 P 5fb4223742d04ce1805ba708378e2a1e: Deleting consensus metadata
I20260809 00:47:19.360837 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 14053
W20260809 00:47:19.382472 13923 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:33019 (error 108)
I20260809 00:47:19.383186 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 14261
I20260809 00:47:19.384675 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.384126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44768)
0809 00:47:19.384389 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.384510 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
W20260809 00:47:19.384930 13923 catalog_manager.cc:4584] TS 5fb4223742d04ce1805ba708378e2a1e (127.28.92.129:33019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 295d20e79f8f47d9bb721c4e55c2d644: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Aug 09 00:47:19 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:47:19.406473 14698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.384393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33450 (local address 127.28.92.130:42569)
0809 00:47:19.384580 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.384589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.384608 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:47:19.384671 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.384678 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.384773 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.384883 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:19.386675 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.387526 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.389372 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.390039 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.390140 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.400421 (+ 10281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:19.400434 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:19.400450 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:19.400494 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:19.403619 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:19.404326 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:19.404334 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:19.404336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:19.404495 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:19.404884 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:19.404888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:19.404890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:19.405248 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:19.405609 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.405905 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.406121 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:47:19.407259 14441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:19.438658 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.438111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44780)
0809 00:47:19.438351 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.438478 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 00:47:19.439803 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.439365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44788)
0809 00:47:19.439527 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.439613 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 00:47:19.500283 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.499692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44794)
0809 00:47:19.499967 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.500087 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260809 00:47:19.501616 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.501114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44796)
0809 00:47:19.501345 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.501432 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 00:47:19.520911 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 14261
I20260809 00:47:19.548461 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 14458
Aug 09 00:47:19 dist-test-slave-t7g5 krb5kdc[13871](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236436, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:47:19.562309 14705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.549184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38712 (local address 127.28.92.131:33335)
0809 00:47:19.549341 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 00:47:19.549345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:47:19.549364 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:47:19.549514 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:47:19.549518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:47:19.549583 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:47:19.549692 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:47:19.550852 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.551563 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.552722 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:47:19.553114 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:47:19.553199 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:47:19.557240 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:47:19.557256 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:47:19.557274 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:47:19.557311 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:47:19.559827 (+ 2516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:19.560435 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:19.560445 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:19.560448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:19.560680 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:47:19.561018 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:47:19.561021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:47:19.561023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:47:19.561379 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:47:19.561600 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 00:47:19.561881 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 00:47:19.562063 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 00:47:19.562904 14667 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:19.582365 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.581920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44812)
0809 00:47:19.582128 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.582219 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 00:47:19.583400 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.583013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44826)
0809 00:47:19.583203 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.583285 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260809 00:47:19.650005 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 14458
I20260809 00:47:19.673169 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 13893
I20260809 00:47:19.674440 14002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:47:19.783249 14699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:47:19.782806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33019 (local address 127.0.0.1:44836)
0809 00:47:19.782975 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 00:47:19.783081 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 00:47:19.783304 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 13893
2026-08-09T00:47:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4449 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:47:19 dist-test-slave-t7g5 krb5kdc[14759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:47:19 dist-test-slave-t7g5 krb5kdc[14759](info): set up 2 sockets
Aug 09 00:47:19 dist-test-slave-t7g5 krb5kdc[14759](info): commencing operation
krb5kdc: starting...
W20260809 00:47:21.016626 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:47:21 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:47:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:47:21Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/rangeradmin_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/rangeradmin_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/rangerlookup_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/rangerlookup_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
I20260809 00:47:21.392136 29042 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksLdMAp/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/postgres -l logfile start
2026-08-09 00:47:23.690 UTC [14805] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 00:47:23.690 UTC [14805] LOG: listening on IPv4 address "127.28.92.148", port 34579
2026-08-09 00:47:23.693 UTC [14805] LOG: listening on Unix socket "/tmp/.s.PGSQL.34579"
2026-08-09 00:47:23.715 UTC [14808] LOG: database system was shut down at 2026-08-09 00:47:22 UTC
2026-08-09 00:47:23.718 UTC [14805] LOG: database system is ready to accept connections
I20260809 00:47:24.818624 29042 mini_postgres.cc:96] Postgres bound to 34579
2026-08-09 00:47:24.841 UTC [14823] FATAL: database "slave" does not exist
127.28.92.148:34579 - accepting connections
I20260809 00:47:24.842824 29042 mini_ranger.cc:161] Starting Ranger...
I20260809 00:47:24.873067 29042 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 00:47:25.307052 29042 mini_ranger.cc:87] Created ranger Postgres database
I20260809 00:47:25.307183 29042 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-admin
2026-08-09 00:47:25,637 [I] DB FLAVOR :POSTGRES
2026-08-09 00:47:25,638 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 00:47:25,638 [I] Checking connection..
2026-08-09 00:47:25,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 00:47:25,901 [I] Checking connection passed.
2026-08-09 00:47:25,902 [I] --------- Verifying version history table ---------
2026-08-09 00:47:25,902 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 00:47:26,164 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 00:47:26,164 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 00:47:26,422 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 00:47:26,422 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 00:47:26,422 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 00:47:26.676 UTC [14910] WARNING: there is no transaction in progress
2026-08-09 00:47:26,683 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 00:47:26,683 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 00:47:26,947 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 00:47:26,947 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 00:47:26,947 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 00:47:27,178 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 00:47:27,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t7g5.c.gcp-upstream.internal','N') ;"
2026-08-09 00:47:27,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 00:47:27,913 [I] Table x_portal_user does not exist in database ranger
2026-08-09 00:47:27,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 00:47:28,173 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 00:47:28,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 00:47:28,424 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 00:47:28,674 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 00:47:28,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 00:47:29.556 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.572 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.587 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.601 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.619 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.637 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.695 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.701 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.715 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.725 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.735 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.747 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.755 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.761 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.767 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:29.773 UTC [15068] WARNING: there is no transaction in progress
2026-08-09 00:47:30,331 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 00:47:30,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 00:47:30,580 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 00:47:30,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 00:47:30,845 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 00:47:30,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 00:47:31,099 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 00:47:31,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 00:47:31,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 00:47:31,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t7g5.c.gcp-upstream.internal';"
2026-08-09 00:47:31,861 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 00:47:31,861 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 00:47:32,113 [I] DB_PATCHES have already been applied
I20260809 00:47:32.119505 29042 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksLdMAp/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 00:47:32.119604 29042 mini_ranger.cc:193] Using host: 127.28.92.148
I20260809 00:47:32.139020 29042 mini_ranger.cc:227] Ranger admin URL: http://127.28.92.148:44159
Aug 09, 2026 12:47:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 12:47:32 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 12:47:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 12:47:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 12:47:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 12:47:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 12:47:33 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 00:47:33.416757 29042 mini_ranger.cc:160] Time spent starting Ranger: real 8.574s user 0.000s sys 0.058s
Aug 09, 2026 12:47:52 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 12:47:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 09, 2026 12:47:52 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 12:47:53 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 12:47:53 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 00:47:54.531649 29042 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/rangerkms_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/rangerkms_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.92.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.28.92.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 00:47:54 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236474, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 00:47:54.758736 29042 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 00:47:54.785919 29042 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 00:47:55.545919 29042 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 00:47:55.546073 29042 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms
I20260809 00:47:55.546192 29042 mini_ranger_kms.cc:227] Using postgres at 127.28.92.148:34579
2026-08-09 00:47:56,012 [I] DB FLAVOR :POSTGRES
2026-08-09 00:47:56,013 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 00:47:56,013 [I] Checking connection
2026-08-09 00:47:56,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 00:47:56,243 [I] connection success
2026-08-09 00:47:56,243 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 00:47:56,243 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 00:47:56,243 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 00:47:56,470 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 00:47:56,470 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 00:47:56,470 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 00:47:56,470 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:34579/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 00:47:56,725 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 00:47:57.162396 29042 mini_ranger_kms.cc:310] Created kms service
I20260809 00:47:57.373478 29042 mini_ranger_kms.cc:326] Created kudu user
I20260809 00:47:57.413480 29042 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 00:47:57 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236474, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:47:57.779949 29042 mini_ranger_kms.cc:384] Added ranger policy
I20260809 00:47:57.781479 29042 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 00:47:57.781562 29042 mini_ranger_kms.cc:240] Using host: 127.28.92.148
I20260809 00:47:57.812337 29042 mini_ranger_kms.cc:276] Ranger KMS PID: 15340
I20260809 00:47:57.812517 29042 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.28.92.148:50099
Aug 09, 2026 12:47:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 12:47:58 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 12:47:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 12:47:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 12:47:59 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 12:47:59 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 00:47:59 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786236479, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.92.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 00:48:00 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236479, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.92.148@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:00.454595 29042 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.696s user 0.159s sys 0.352s
I20260809 00:48:00.454950 29042 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 00:48:00.455174 29042 mini_ranger_kms.cc:401] 127.28.92.148:50099/kms/v1/keys
Aug 09 00:48:00 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236479, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.92.148@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
Aug 09 00:48:03 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:48:03.505123 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:44987
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:44987
--ranger_config_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:50099/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:48:04.126680 15407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:04.127094 15407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:04.127351 15407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:04.138517 15407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:48:04.138727 15407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:04.138849 15407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:04.139009 15407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:48:04.139174 15407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:48:04.154834 15407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal
--ranger_kms_url=127.28.92.148:50099/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:44987
--ranger_config_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:44987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:04.156203 15407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:04.157548 15407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:04.171571 15416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:04.171571 15417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:04.171594 15419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:04.178354 15407 server_base.cc:1034] running on GCE node
I20260809 00:48:04.179317 15407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:04.180771 15407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:04.181972 15407 hybrid_clock.cc:648] HybridClock initialized: now 1786236484181930 us; error 35 us; skew 500 ppm
I20260809 00:48:04.182334 15407 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:04 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236484, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:04.185623 15407 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:48:04.187800 15407 webserver.cc:460] Webserver started at http://127.28.92.190:34523/ using document root <none> and password file <none>
I20260809 00:48:04.188623 15407 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:04.188781 15407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:04.189141 15407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:04 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236484, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:04.249871 15407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "7cfceef566b645f48702a108906e6630"
format_stamp: "Formatted at 2026-08-09 00:48:04 on dist-test-slave-t7g5"
server_key: "9d3742631a6b385ca966defad5804c1f"
server_key_iv: "dbd57c1e7d90c3892a0e0f9d897ccb1a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:04.250735 15407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "7cfceef566b645f48702a108906e6630"
format_stamp: "Formatted at 2026-08-09 00:48:04 on dist-test-slave-t7g5"
server_key: "9d3742631a6b385ca966defad5804c1f"
server_key_iv: "dbd57c1e7d90c3892a0e0f9d897ccb1a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:04.257153 15407 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260809 00:48:04.278848 15432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:04.280804 15407 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260809 00:48:04.281105 15407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "7cfceef566b645f48702a108906e6630"
format_stamp: "Formatted at 2026-08-09 00:48:04 on dist-test-slave-t7g5"
server_key: "9d3742631a6b385ca966defad5804c1f"
server_key_iv: "dbd57c1e7d90c3892a0e0f9d897ccb1a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:04.281424 15407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:04.297142 15407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:04.301415 15407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:04.301806 15407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:04.332798 15407 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:44987
I20260809 00:48:04.332836 15507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:44987 every 8 connection(s)
I20260809 00:48:04.334676 15407 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:48:04.339707 15509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:48:04.344620 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 15407
I20260809 00:48:04.344796 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:48:04.345484 29042 external_mini_cluster.cc:1428] Setting key b71d684930411276834cf4d0ffaa6635
I20260809 00:48:04.352967 15509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630: Bootstrap starting.
I20260809 00:48:04.357163 15509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630: Neither blocks nor log segments found. Creating new log.
I20260809 00:48:04.358668 15509 log.cc:824] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630: Log is configured to *not* fsync() on all Append() calls
Aug 09 00:48:04 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:04.362324 15509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630: No bootstrap required, opened a new log
I20260809 00:48:04.371949 15514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:04.347556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39406 (local address 127.28.92.190:44987)
0809 00:48:04.348667 (+ 1111us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:04.348678 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:04.348722 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:48:04.351006 (+ 2284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:04.351028 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:04.351404 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:04.351721 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:04.353371 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:04.355222 (+ 1851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:04.356952 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:04.358065 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:04.358236 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:04.362415 (+ 4179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:04.362430 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:04.362449 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:04.362486 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:04.367470 (+ 4984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:04.368109 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:04.368116 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:04.368122 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:04.368359 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:04.368728 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:04.368735 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:04.368737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:04.369422 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:04.369946 (+ 524us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:04.370239 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 00:48:04.370643 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":880,"thread_start_us":598,"threads_started":1}
I20260809 00:48:04.373891 15509 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cfceef566b645f48702a108906e6630" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44987 } }
I20260809 00:48:04.374313 15509 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:48:04.374428 15509 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cfceef566b645f48702a108906e6630, State: Initialized, Role: FOLLOWER
I20260809 00:48:04.374985 15509 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cfceef566b645f48702a108906e6630" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44987 } }
I20260809 00:48:04.375366 15509 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:48:04.375577 15509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:48:04.375770 15509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:48:04.378549 15509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cfceef566b645f48702a108906e6630" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44987 } }
I20260809 00:48:04.379236 15509 leader_election.cc:302] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cfceef566b645f48702a108906e6630; no voters:
I20260809 00:48:04.380290 15509 leader_election.cc:288] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:48:04.380394 15516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:48:04.382324 15516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [term 1 LEADER]: Becoming Leader. State: Replica: 7cfceef566b645f48702a108906e6630, State: Running, Role: LEADER
I20260809 00:48:04.383224 15516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cfceef566b645f48702a108906e6630" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44987 } }
I20260809 00:48:04.383705 15509 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:48:04.387797 15519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cfceef566b645f48702a108906e6630. Latest consensus state: current_term: 1 leader_uuid: "7cfceef566b645f48702a108906e6630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cfceef566b645f48702a108906e6630" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44987 } } }
I20260809 00:48:04.389698 15519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [sys.catalog]: This master's current role is: LEADER
I20260809 00:48:04.388477 15518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cfceef566b645f48702a108906e6630" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cfceef566b645f48702a108906e6630" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44987 } } }
I20260809 00:48:04.390990 15518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630 [sys.catalog]: This master's current role is: LEADER
I20260809 00:48:04.402451 15529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:48:04.402812 15509 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 00:48:04.421327 15529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:48:04.437405 15529 catalog_manager.cc:1347] Generated new cluster ID: d11ad6be5fd748b0b805690966b58f2c
I20260809 00:48:04.437542 15529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:48:04.473135 15529 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:48:04.475462 15529 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:48:04.485625 15529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630: Generated new TSK 0
I20260809 00:48:04.486892 15529 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:48:05.287705 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:50099/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:44987
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:48:05 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786236485, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 00:48:05.776420 15578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:05.776976 15578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:05.777345 15578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:05.790053 15578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:05.790237 15578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:05.790467 15578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:48:05.803812 15578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.28.92.148:50099/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:05.805418 15578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:05.807150 15578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:05.828931 15589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:05.832832 15590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:05.842442 15578 server_base.cc:1034] running on GCE node
W20260809 00:48:05.843200 15592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:05.844023 15578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:05.845233 15578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:05.846509 15578 hybrid_clock.cc:648] HybridClock initialized: now 1786236485846448 us; error 55 us; skew 500 ppm
I20260809 00:48:05.846845 15578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:05 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236485, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:05.851511 15578 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:48:05.855186 15578 webserver.cc:460] Webserver started at http://127.28.92.129:44781/ using document root <none> and password file <none>
I20260809 00:48:05.856338 15578 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:05.856573 15578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:05.856966 15578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:05 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236485, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:05.878465 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "eff108f2007e4ec486da681b4766fcce"
format_stamp: "Formatted at 2026-08-09 00:48:05 on dist-test-slave-t7g5"
server_key: "e08839dca3f4b1644bbca93deb210cc4"
server_key_iv: "d043dae3cb26e88f4ba7ccdcc1bea803"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:05.879745 15578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "eff108f2007e4ec486da681b4766fcce"
format_stamp: "Formatted at 2026-08-09 00:48:05 on dist-test-slave-t7g5"
server_key: "e08839dca3f4b1644bbca93deb210cc4"
server_key_iv: "d043dae3cb26e88f4ba7ccdcc1bea803"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:05.892719 15578 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.008s sys 0.004s
I20260809 00:48:05.931109 15601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:05.933393 15578 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.004s sys 0.012s
I20260809 00:48:05.933746 15578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "eff108f2007e4ec486da681b4766fcce"
format_stamp: "Formatted at 2026-08-09 00:48:05 on dist-test-slave-t7g5"
server_key: "e08839dca3f4b1644bbca93deb210cc4"
server_key_iv: "d043dae3cb26e88f4ba7ccdcc1bea803"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:05.934172 15578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:05.974799 15578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:05.979979 15578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:05.980475 15578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:05.982126 15578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:05.983825 15578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:05.983933 15578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:05.984069 15578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:05.984127 15578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 00:48:06 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236485, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:06.418833 15578 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:34639
I20260809 00:48:06.418959 15779 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:34639 every 8 connection(s)
I20260809 00:48:06.420894 15578 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:48:06.428167 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 15578
I20260809 00:48:06.428448 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:48:06.429559 29042 external_mini_cluster.cc:1428] Setting key caa213f689de9b4e61968317c10b26ee
Aug 09 00:48:06 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236485, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
I20260809 00:48:06.482216 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:06.425978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44987 (local address 127.28.92.129:55505)
0809 00:48:06.438633 (+ 12655us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:06.438695 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:06.442986 (+ 4291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:06.444389 (+ 1403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:06.444405 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:06.445177 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:06.446209 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:06.446240 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:06.448011 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:06.448017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:06.450676 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:06.450694 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:06.452351 (+ 1657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:06.452361 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:06.452721 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:06.458445 (+ 5724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:06.458482 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:06.466731 (+ 8249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:06.472791 (+ 6060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:06.472803 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:06.472826 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:06.473724 (+ 898us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:06.474293 (+ 569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:06.474297 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:06.474301 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:06.474719 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:06.478471 (+ 3752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:06.478480 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:06.478995 (+ 515us) client_negotiation.cc:769] Sending connection context
0809 00:48:06.479375 (+ 380us) client_negotiation.cc:240] Negotiation successful
0809 00:48:06.480043 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12304,"thread_start_us":12029,"threads_started":1}
I20260809 00:48:06.482825 15783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:06.424774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:55505 (local address 127.28.92.190:44987)
0809 00:48:06.442549 (+ 17775us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:06.442555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:06.442578 (+ 23us) server_negotiation.cc:407] Connection header received
0809 00:48:06.443512 (+ 934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:06.443520 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:06.443618 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:06.443771 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:06.446469 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:06.447702 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:06.450901 (+ 3199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:06.451756 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:06.451886 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:06.467162 (+ 15276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:06.467171 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:06.467177 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:06.467256 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:06.472539 (+ 5283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:06.473917 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:06.473924 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:06.473928 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:06.474142 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:06.477697 (+ 3555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:06.477704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:06.477708 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:06.478225 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:06.478378 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:06.481695 (+ 3317us) server_negotiation.cc:299] Negotiation successful
0809 00:48:06.482170 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17639,"thread_start_us":17505,"threads_started":1}
I20260809 00:48:06.484597 15781 heartbeater.cc:347] Connected to a master server at 127.28.92.190:44987
I20260809 00:48:06.485097 15781 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
I20260809 00:48:06.490378 15781 heartbeater.cc:511] Master 127.28.92.190:44987 requested a full tablet report, sending...
I20260809 00:48:06.493480 15457 ts_manager.cc:194] Registered new tserver with Master: eff108f2007e4ec486da681b4766fcce (127.28.92.129:34639)
I20260809 00:48:06.496011 15457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:55505
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:48:06.527624 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:50099/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:44987
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:48:06 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236485, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
W20260809 00:48:07.232407 15788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:07.232803 15788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:07.233008 15788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:07.244429 15788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:07.244549 15788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:07.244675 15788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:48:07.257862 15788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.28.92.148:50099/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:07.259234 15788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:07.260641 15788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:07.275341 15807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:07.276130 15812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:07.276185 15808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:07.277210 15788 server_base.cc:1034] running on GCE node
I20260809 00:48:07.277980 15788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:07.279201 15788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:07.280428 15788 hybrid_clock.cc:648] HybridClock initialized: now 1786236487280369 us; error 31 us; skew 500 ppm
I20260809 00:48:07.280781 15788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:07 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236487, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:07.285465 15788 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:48:07.287458 15788 webserver.cc:460] Webserver started at http://127.28.92.130:39915/ using document root <none> and password file <none>
I20260809 00:48:07.288333 15788 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:07.288548 15788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:07.288954 15788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:07 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236487, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:07.305357 15788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "2b519e17c227420aa19ba3df9a310c5c"
format_stamp: "Formatted at 2026-08-09 00:48:07 on dist-test-slave-t7g5"
server_key: "bd6841f8c4aca10a4a6607355a902673"
server_key_iv: "d94efd1f8625cd42cfc8ad257c40d2f0"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:07.306458 15788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "2b519e17c227420aa19ba3df9a310c5c"
format_stamp: "Formatted at 2026-08-09 00:48:07 on dist-test-slave-t7g5"
server_key: "bd6841f8c4aca10a4a6607355a902673"
server_key_iv: "d94efd1f8625cd42cfc8ad257c40d2f0"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:07.313455 15788 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260809 00:48:07.330030 15823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:07.331691 15788 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260809 00:48:07.331869 15788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "2b519e17c227420aa19ba3df9a310c5c"
format_stamp: "Formatted at 2026-08-09 00:48:07 on dist-test-slave-t7g5"
server_key: "bd6841f8c4aca10a4a6607355a902673"
server_key_iv: "d94efd1f8625cd42cfc8ad257c40d2f0"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:07.332113 15788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:07.351297 15788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:07.356511 15788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:07.356910 15788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:07.358642 15788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:07.361034 15788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:07.361178 15788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:07.361404 15788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:07.361588 15788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:07.456105 15788 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:36317
I20260809 00:48:07.456453 15994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:36317 every 8 connection(s)
I20260809 00:48:07.457774 15788 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:48:07.458191 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 15788
I20260809 00:48:07.458375 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:48:07.459026 29042 external_mini_cluster.cc:1428] Setting key 97426bd2ee868b20604c2d1f70ba0c59
Aug 09 00:48:07 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236487, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:07.500305 15781 heartbeater.cc:503] Master 127.28.92.190:44987 was elected leader, sending a full tablet report...
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
I20260809 00:48:07.510460 15997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:07.463043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:53459 (local address 127.28.92.190:44987)
0809 00:48:07.478463 (+ 15420us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:07.478471 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:07.482990 (+ 4519us) server_negotiation.cc:407] Connection header received
0809 00:48:07.485628 (+ 2638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:07.485634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:07.485752 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:07.485985 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:07.488672 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:07.490259 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:07.493596 (+ 3337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:07.494655 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:07.494839 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:07.501441 (+ 6602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:07.501451 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:07.501456 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:07.501505 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:07.506331 (+ 4826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:07.507406 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:07.507412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:07.507415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:07.507585 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:07.508143 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:07.508148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:07.508151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:07.508549 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:07.508684 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:07.509761 (+ 1077us) server_negotiation.cc:299] Negotiation successful
0809 00:48:07.510022 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15239,"thread_start_us":15428,"threads_started":1}
I20260809 00:48:07.511411 15998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:07.463818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44987 (local address 127.28.92.130:53459)
0809 00:48:07.482557 (+ 18739us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:07.482619 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:07.485232 (+ 2613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:07.486556 (+ 1324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:07.486571 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:07.487297 (+ 726us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:07.488424 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:07.488461 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:07.490532 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:07.490539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:07.493422 (+ 2883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:07.493437 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:07.495079 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:07.495089 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:07.495507 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:07.496679 (+ 1172us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:07.496715 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:07.500985 (+ 4270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:07.506528 (+ 5543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:07.506539 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:07.506561 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:07.507266 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:07.507716 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:07.507721 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:07.507725 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:07.508029 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:07.508705 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:07.508714 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:07.509214 (+ 500us) client_negotiation.cc:769] Sending connection context
0809 00:48:07.509594 (+ 380us) client_negotiation.cc:240] Negotiation successful
0809 00:48:07.510088 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18354,"thread_start_us":18056,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
I20260809 00:48:07.513243 15995 heartbeater.cc:347] Connected to a master server at 127.28.92.190:44987
I20260809 00:48:07.513603 15995 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:07.514565 15995 heartbeater.cc:511] Master 127.28.92.190:44987 requested a full tablet report, sending...
I20260809 00:48:07.516275 15457 ts_manager.cc:194] Registered new tserver with Master: 2b519e17c227420aa19ba3df9a310c5c (127.28.92.130:36317)
I20260809 00:48:07.517545 15457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:53459
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:48:07.558918 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:50099/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:44987
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:48:08.239074 16006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:08.239477 16006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:08.239723 16006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:08.251173 16006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:08.251385 16006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:08.251605 16006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:48:08.267073 16006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.28.92.148:50099/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:44987
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:08.268790 16006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:08.270563 16006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:08.290246 16016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:08.290144 16014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:08.292750 16013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:08.294782 16006 server_base.cc:1034] running on GCE node
I20260809 00:48:08.295827 16006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:08.297132 16006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:08.298408 16006 hybrid_clock.cc:648] HybridClock initialized: now 1786236488298239 us; error 98 us; skew 500 ppm
I20260809 00:48:08.298920 16006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:08 dist-test-slave-t7g5 krb5kdc[14759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236488, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:08.303331 16006 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:48:08.305831 16006 webserver.cc:460] Webserver started at http://127.28.92.131:45471/ using document root <none> and password file <none>
I20260809 00:48:08.306782 16006 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:08.306989 16006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:08.307444 16006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:08 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236488, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:08.324117 16006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "5e98e977cb24401fa3a172b64f95da39"
format_stamp: "Formatted at 2026-08-09 00:48:08 on dist-test-slave-t7g5"
server_key: "bcd6229fea787076cc070ce04d228d28"
server_key_iv: "2399a0df01c34732070fb55e37185a08"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:08.325309 16006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "5e98e977cb24401fa3a172b64f95da39"
format_stamp: "Formatted at 2026-08-09 00:48:08 on dist-test-slave-t7g5"
server_key: "bcd6229fea787076cc070ce04d228d28"
server_key_iv: "2399a0df01c34732070fb55e37185a08"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:08.332093 16006 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260809 00:48:08.352474 16025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:08.354421 16006 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260809 00:48:08.354648 16006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "5e98e977cb24401fa3a172b64f95da39"
format_stamp: "Formatted at 2026-08-09 00:48:08 on dist-test-slave-t7g5"
server_key: "bcd6229fea787076cc070ce04d228d28"
server_key_iv: "2399a0df01c34732070fb55e37185a08"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:08.354941 16006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:08.382318 16006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:08.388953 16006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:08.389569 16006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:08.391376 16006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:08.393456 16006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:08.393550 16006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:08.393667 16006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:08.393719 16006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 00:48:08.492765 16006 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:39597
I20260809 00:48:08.492949 16189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:39597 every 8 connection(s)
I20260809 00:48:08.494606 16006 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:48:08.494793 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 16006
I20260809 00:48:08.494946 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:48:08.495524 29042 external_mini_cluster.cc:1428] Setting key 96fc08b5c0525a5ce62d26ca6708a702
Aug 09 00:48:08 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236488, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:08.520996 15995 heartbeater.cc:503] Master 127.28.92.190:44987 was elected leader, sending a full tablet report...
I20260809 00:48:08.527770 16192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.499561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:48219 (local address 127.28.92.190:44987)
0809 00:48:08.500697 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.500702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.502388 (+ 1686us) server_negotiation.cc:407] Connection header received
0809 00:48:08.506691 (+ 4303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.506695 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.506757 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.507013 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:08.509882 (+ 2869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.511392 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.513955 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.514683 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.514801 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.519291 (+ 4490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:08.519297 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:08.519301 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:08.519341 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:08.524322 (+ 4981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:08.525100 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:08.525104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:08.525106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:08.525274 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:08.525831 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:08.525835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:08.525837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:08.526301 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:08.526421 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.527135 (+ 714us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.527314 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1027,"thread_start_us":738,"threads_started":1}
I20260809 00:48:08.529022 16193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.500430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44987 (local address 127.28.92.131:48219)
0809 00:48:08.502041 (+ 1611us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:08.502090 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:08.506341 (+ 4251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:08.507374 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:08.507386 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:08.508415 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:08.509629 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.509681 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.511729 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.511735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.513791 (+ 2056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.513804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.514956 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.514963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.515309 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.516057 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:08.516081 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:08.519014 (+ 2933us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:08.524495 (+ 5481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:08.524503 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:08.524517 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:08.525009 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:08.525351 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:08.525354 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:08.525356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:08.525708 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:08.526402 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:08.526408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:08.526808 (+ 400us) client_negotiation.cc:769] Sending connection context
0809 00:48:08.527044 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 00:48:08.527563 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1299,"thread_start_us":852,"threads_started":1}
I20260809 00:48:08.530659 16190 heartbeater.cc:347] Connected to a master server at 127.28.92.190:44987
I20260809 00:48:08.531051 16190 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:08.532058 16190 heartbeater.cc:511] Master 127.28.92.190:44987 requested a full tablet report, sending...
I20260809 00:48:08.533733 15457 ts_manager.cc:194] Registered new tserver with Master: 5e98e977cb24401fa3a172b64f95da39 (127.28.92.131:39597)
I20260809 00:48:08.534974 15457 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:48219
I20260809 00:48:08.536912 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:48:08.562464 16192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.543531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39410 (local address 127.28.92.190:44987)
0809 00:48:08.543731 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.543739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.544547 (+ 808us) server_negotiation.cc:407] Connection header received
0809 00:48:08.544733 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.544737 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.544846 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.544922 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:08.547081 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.547922 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.549904 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.550394 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.550496 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.553781 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:08.553787 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:08.553791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:08.553822 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:08.558283 (+ 4461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:08.559183 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:08.559189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:08.559192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:08.559407 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:08.560038 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:08.560043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:08.560046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:08.560421 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:08.560732 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.561692 (+ 960us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.561986 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:48:08.567873 15455 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:48:08.579505 15455 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:48:08.612699 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.597167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55336 (local address 127.28.92.130:36317)
0809 00:48:08.601672 (+ 4505us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.601681 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.601708 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:48:08.601801 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.601807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.602075 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.602520 (+ 445us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:48:08.604125 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.606318 (+ 2193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.609806 (+ 3488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.611049 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.611213 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.611482 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.612120 (+ 638us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.612322 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4322,"thread_start_us":4048,"threads_started":1}
I20260809 00:48:08.612704 16206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.596473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:39597 (local address 127.0.0.1:33396)
0809 00:48:08.598344 (+ 1871us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:08.598396 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:08.598779 (+ 383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:08.600875 (+ 2096us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:08.600882 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:08.600914 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:48:08.601858 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.601873 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.604896 (+ 3023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.604901 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.608736 (+ 3835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.608748 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.611576 (+ 2828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.611583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.611821 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.611874 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 00:48:08.612029 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 00:48:08.612236 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1546,"thread_start_us":1334,"threads_started":1}
I20260809 00:48:08.613415 16209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.597001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:36317 (local address 127.0.0.1:55336)
0809 00:48:08.600464 (+ 3463us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:08.600496 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:08.600803 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:08.602502 (+ 1699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:08.602507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:08.602537 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:48:08.603825 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.603839 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.606454 (+ 2615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.606458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.609636 (+ 3178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.609671 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.611689 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.611697 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.611904 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.611941 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:48:08.612965 (+ 1024us) client_negotiation.cc:240] Negotiation successful
0809 00:48:08.613095 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3307,"thread_start_us":3088,"threads_started":1}
I20260809 00:48:08.614025 16210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.597185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.28.92.131:39597)
0809 00:48:08.599855 (+ 2670us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.599864 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.599930 (+ 66us) server_negotiation.cc:407] Connection header received
0809 00:48:08.600091 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.600100 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.600353 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.602090 (+ 1737us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:48:08.602650 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.604651 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.608876 (+ 4225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.610931 (+ 2055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.611083 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.611339 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.613145 (+ 1806us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.613450 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2446,"thread_start_us":2183,"threads_started":1}
I20260809 00:48:08.616724 16212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.601911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34639 (local address 127.0.0.1:52260)
0809 00:48:08.603902 (+ 1991us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:08.603921 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:08.604236 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:08.605107 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:08.605111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:08.605137 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:48:08.606240 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.606253 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.609142 (+ 2889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.609147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.612181 (+ 3034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.612195 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.615778 (+ 3583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.615786 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.615978 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.616013 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 00:48:08.616098 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 00:48:08.616225 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1843,"thread_start_us":1537,"threads_started":1}
I20260809 00:48:08.617785 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.601280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52260 (local address 127.28.92.129:34639)
0809 00:48:08.602298 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.602307 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.604357 (+ 2050us) server_negotiation.cc:407] Connection header received
0809 00:48:08.604463 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.604469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.604718 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.605123 (+ 405us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:48:08.606478 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.608973 (+ 2495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.612397 (+ 3424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.614983 (+ 2586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.615177 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.615528 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.617028 (+ 1500us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.617238 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":797,"threads_started":1}
I20260809 00:48:08.618820 15897 tablet_service.cc:1467] Processing CreateTablet for tablet 6cd2beebaaaa4b05b5f96e0b487fd934 (DEFAULT_TABLE table=test-table [id=7eb3db6a06a24ef1a29cd8ea7516ae2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:48:08.620492 15897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cd2beebaaaa4b05b5f96e0b487fd934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:48:08.622555 15674 tablet_service.cc:1467] Processing CreateTablet for tablet 6cd2beebaaaa4b05b5f96e0b487fd934 (DEFAULT_TABLE table=test-table [id=7eb3db6a06a24ef1a29cd8ea7516ae2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:48:08.624827 15674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cd2beebaaaa4b05b5f96e0b487fd934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:48:08.626004 16092 tablet_service.cc:1467] Processing CreateTablet for tablet 6cd2beebaaaa4b05b5f96e0b487fd934 (DEFAULT_TABLE table=test-table [id=7eb3db6a06a24ef1a29cd8ea7516ae2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:48:08.628237 16092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cd2beebaaaa4b05b5f96e0b487fd934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:48:08.635677 16213 tablet_bootstrap.cc:492] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Bootstrap starting.
I20260809 00:48:08.641814 16213 tablet_bootstrap.cc:654] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Neither blocks nor log segments found. Creating new log.
I20260809 00:48:08.643656 16213 log.cc:824] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Log is configured to *not* fsync() on all Append() calls
I20260809 00:48:08.645499 16215 tablet_bootstrap.cc:492] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Bootstrap starting.
I20260809 00:48:08.647517 16217 tablet_bootstrap.cc:492] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Bootstrap starting.
I20260809 00:48:08.652223 16213 tablet_bootstrap.cc:492] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: No bootstrap required, opened a new log
I20260809 00:48:08.652690 16213 ts_tablet_manager.cc:1397] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.008s
I20260809 00:48:08.653185 16215 tablet_bootstrap.cc:654] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Neither blocks nor log segments found. Creating new log.
I20260809 00:48:08.653247 16217 tablet_bootstrap.cc:654] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Neither blocks nor log segments found. Creating new log.
I20260809 00:48:08.655365 16217 log.cc:824] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Log is configured to *not* fsync() on all Append() calls
I20260809 00:48:08.655954 16215 log.cc:824] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Log is configured to *not* fsync() on all Append() calls
I20260809 00:48:08.660027 16217 tablet_bootstrap.cc:492] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: No bootstrap required, opened a new log
I20260809 00:48:08.660176 16215 tablet_bootstrap.cc:492] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: No bootstrap required, opened a new log
I20260809 00:48:08.660440 16217 ts_tablet_manager.cc:1397] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260809 00:48:08.660629 16215 ts_tablet_manager.cc:1397] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.012s
I20260809 00:48:08.670882 16213 raft_consensus.cc:348] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.671490 16213 raft_consensus.cc:374] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:48:08.671752 16213 raft_consensus.cc:729] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b519e17c227420aa19ba3df9a310c5c, State: Initialized, Role: FOLLOWER
I20260809 00:48:08.672703 16213 consensus_queue.cc:260] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.673681 16215 raft_consensus.cc:348] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.674257 16215 raft_consensus.cc:374] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:48:08.674453 16215 raft_consensus.cc:729] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eff108f2007e4ec486da681b4766fcce, State: Initialized, Role: FOLLOWER
I20260809 00:48:08.675098 16213 ts_tablet_manager.cc:1428] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Time spent starting tablet: real 0.022s user 0.018s sys 0.005s
I20260809 00:48:08.675312 16215 consensus_queue.cc:260] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.675992 16217 raft_consensus.cc:348] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.676656 16217 raft_consensus.cc:374] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:48:08.677794 16215 ts_tablet_manager.cc:1428] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Time spent starting tablet: real 0.017s user 0.016s sys 0.001s
I20260809 00:48:08.676839 16217 raft_consensus.cc:729] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e98e977cb24401fa3a172b64f95da39, State: Initialized, Role: FOLLOWER
I20260809 00:48:08.678956 16217 consensus_queue.cc:260] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.680853 16190 heartbeater.cc:503] Master 127.28.92.190:44987 was elected leader, sending a full tablet report...
I20260809 00:48:08.682356 16217 ts_tablet_manager.cc:1428] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Time spent starting tablet: real 0.022s user 0.014s sys 0.004s
W20260809 00:48:08.685958 15782 tablet.cc:2369] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:48:08.712304 15996 tablet.cc:2369] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:48:08.713469 16228 raft_consensus.cc:482] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:48:08.714025 16228 raft_consensus.cc:504] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.715992 16228 leader_election.cc:288] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b519e17c227420aa19ba3df9a310c5c (127.28.92.130:36317), eff108f2007e4ec486da681b4766fcce (127.28.92.129:34639)
I20260809 00:48:08.723109 16193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.716403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:36317 (local address 127.28.92.131:49199)
0809 00:48:08.716602 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:08.716624 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:08.716754 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:08.717138 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:08.717148 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:08.717176 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:48:08.717520 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.717532 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.718957 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.718961 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.720886 (+ 1925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.720899 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.722296 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.722302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.722529 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.722554 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 00:48:08.722656 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 00:48:08.722789 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":17}
I20260809 00:48:08.723090 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.716465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:49199 (local address 127.28.92.130:36317)
0809 00:48:08.716667 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.716672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.716692 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:48:08.716918 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.716923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.717006 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.717097 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:48:08.717697 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.718786 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.721034 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.722154 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.722311 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.722389 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.722702 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.722827 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:48:08.725091 15923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd2beebaaaa4b05b5f96e0b487fd934" candidate_uuid: "5e98e977cb24401fa3a172b64f95da39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b519e17c227420aa19ba3df9a310c5c" is_pre_election: true
I20260809 00:48:08.725915 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.717108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:42637 (local address 127.28.92.129:34639)
0809 00:48:08.717318 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.717324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.718314 (+ 990us) server_negotiation.cc:407] Connection header received
0809 00:48:08.718451 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.718456 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.718535 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.718651 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:48:08.719721 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.720761 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.723531 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.724858 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.725017 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.725072 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.725510 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.725607 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:48:08.726022 15923 raft_consensus.cc:2454] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e98e977cb24401fa3a172b64f95da39 in term 0.
I20260809 00:48:08.726954 16231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.716896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34639 (local address 127.28.92.131:42637)
0809 00:48:08.718035 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:08.718051 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:08.718337 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:08.718668 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:08.718673 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:08.718697 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:48:08.719532 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.719545 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.720917 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.720920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.723282 (+ 2362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:08.723297 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.725120 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.725128 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:08.725338 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.725376 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 00:48:08.725485 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 00:48:08.725624 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":17,"thread_start_us":845,"threads_started":1}
I20260809 00:48:08.727294 16027 leader_election.cc:302] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b519e17c227420aa19ba3df9a310c5c, 5e98e977cb24401fa3a172b64f95da39; no voters:
I20260809 00:48:08.727881 16228 raft_consensus.cc:2781] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:48:08.728139 16228 raft_consensus.cc:482] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:48:08.728335 16228 raft_consensus.cc:3037] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:48:08.729146 15711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd2beebaaaa4b05b5f96e0b487fd934" candidate_uuid: "5e98e977cb24401fa3a172b64f95da39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eff108f2007e4ec486da681b4766fcce" is_pre_election: true
I20260809 00:48:08.729737 15711 raft_consensus.cc:2454] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e98e977cb24401fa3a172b64f95da39 in term 0.
I20260809 00:48:08.732465 16228 raft_consensus.cc:504] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.733202 16228 leader_election.cc:288] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [CANDIDATE]: Term 1 election: Requested vote from peers 2b519e17c227420aa19ba3df9a310c5c (127.28.92.130:36317), eff108f2007e4ec486da681b4766fcce (127.28.92.129:34639)
I20260809 00:48:08.733731 15923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd2beebaaaa4b05b5f96e0b487fd934" candidate_uuid: "5e98e977cb24401fa3a172b64f95da39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b519e17c227420aa19ba3df9a310c5c"
I20260809 00:48:08.733790 15711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cd2beebaaaa4b05b5f96e0b487fd934" candidate_uuid: "5e98e977cb24401fa3a172b64f95da39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eff108f2007e4ec486da681b4766fcce"
I20260809 00:48:08.734009 15923 raft_consensus.cc:3037] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:48:08.734056 15711 raft_consensus.cc:3037] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:48:08.736779 15711 raft_consensus.cc:2454] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e98e977cb24401fa3a172b64f95da39 in term 1.
I20260809 00:48:08.736799 15923 raft_consensus.cc:2454] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e98e977cb24401fa3a172b64f95da39 in term 1.
I20260809 00:48:08.737161 16027 leader_election.cc:302] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e98e977cb24401fa3a172b64f95da39, eff108f2007e4ec486da681b4766fcce; no voters:
I20260809 00:48:08.737462 16228 raft_consensus.cc:2781] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:48:08.738317 16228 raft_consensus.cc:686] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 1 LEADER]: Becoming Leader. State: Replica: 5e98e977cb24401fa3a172b64f95da39, State: Running, Role: LEADER
I20260809 00:48:08.738893 16228 consensus_queue.cc:237] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } }
I20260809 00:48:08.746161 15457 catalog_manager.cc:5495] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e98e977cb24401fa3a172b64f95da39 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "5e98e977cb24401fa3a172b64f95da39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e98e977cb24401fa3a172b64f95da39" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 } health_report { overall_health: UNKNOWN } } }
W20260809 00:48:08.748266 16191 tablet.cc:2369] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:48:08.767113 16210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.760817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33406 (local address 127.28.92.131:39597)
0809 00:48:08.761019 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.761024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.761129 (+ 105us) server_negotiation.cc:407] Connection header received
0809 00:48:08.761319 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.761323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.761399 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.761533 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:48:08.762101 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.763009 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.764963 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.765497 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.765592 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.766127 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:48:08.766629 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:48:08.766752 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.766825 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.766893 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:48:08.776961 15711 raft_consensus.cc:1261] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 1 FOLLOWER]: Refusing update from remote peer 5e98e977cb24401fa3a172b64f95da39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:48:08.777115 15923 raft_consensus.cc:1261] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 1 FOLLOWER]: Refusing update from remote peer 5e98e977cb24401fa3a172b64f95da39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:48:08.778116 16234 consensus_queue.cc:1035] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eff108f2007e4ec486da681b4766fcce" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:48:08.778622 16228 consensus_queue.cc:1035] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b519e17c227420aa19ba3df9a310c5c" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 36317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:48:08.810441 15457 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:48:08.810773 15457 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:48:08.815037 15457 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cfceef566b645f48702a108906e6630: Sending DeleteTablet for 3 replicas of tablet 6cd2beebaaaa4b05b5f96e0b487fd934
I20260809 00:48:08.816429 16092 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cd2beebaaaa4b05b5f96e0b487fd934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:48:08 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:33396
I20260809 00:48:08.816507 15897 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cd2beebaaaa4b05b5f96e0b487fd934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:48:08 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:55336
I20260809 00:48:08.816578 15674 tablet_service.cc:1514] Processing DeleteTablet for tablet 6cd2beebaaaa4b05b5f96e0b487fd934 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:48:08 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:52260
I20260809 00:48:08.820921 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 15578
I20260809 00:48:08.833809 16258 tablet_replica.cc:330] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: stopping tablet replica
I20260809 00:48:08.834507 16258 raft_consensus.cc:2229] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:48:08.835425 16258 raft_consensus.cc:2258] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:48:08.836898 16255 tablet_replica.cc:330] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: stopping tablet replica
I20260809 00:48:08.839123 16258 ts_tablet_manager.cc:1905] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:48:08.837500 16255 raft_consensus.cc:2229] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:48:08.840135 16255 raft_consensus.cc:2258] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:48:08.842483 16255 ts_tablet_manager.cc:1905] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:48:08.846494 16254 tablet_replica.cc:330] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: stopping tablet replica
I20260809 00:48:08.846983 16254 raft_consensus.cc:2229] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:48:08.847676 16254 raft_consensus.cc:2258] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:48:08.850929 16258 ts_tablet_manager.cc:1918] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:48:08.851238 16258 log.cc:1196] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/6cd2beebaaaa4b05b5f96e0b487fd934
I20260809 00:48:08.851527 16254 ts_tablet_manager.cc:1905] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:48:08.851714 16255 ts_tablet_manager.cc:1918] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:48:08.852077 16258 ts_tablet_manager.cc:1939] T 6cd2beebaaaa4b05b5f96e0b487fd934 P eff108f2007e4ec486da681b4766fcce: Deleting consensus metadata
I20260809 00:48:08.852114 16255 log.cc:1196] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/6cd2beebaaaa4b05b5f96e0b487fd934
I20260809 00:48:08.852908 16255 ts_tablet_manager.cc:1939] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 5e98e977cb24401fa3a172b64f95da39: Deleting consensus metadata
I20260809 00:48:08.854465 15434 catalog_manager.cc:4841] TS eff108f2007e4ec486da681b4766fcce (127.28.92.129:34639): tablet 6cd2beebaaaa4b05b5f96e0b487fd934 (table test-table [id=7eb3db6a06a24ef1a29cd8ea7516ae2c]) successfully deleted
I20260809 00:48:08.855269 15433 catalog_manager.cc:4841] TS 5e98e977cb24401fa3a172b64f95da39 (127.28.92.131:39597): tablet 6cd2beebaaaa4b05b5f96e0b487fd934 (table test-table [id=7eb3db6a06a24ef1a29cd8ea7516ae2c]) successfully deleted
Aug 09 00:48:08 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:48:08.863123 16254 ts_tablet_manager.cc:1918] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:48:08.863446 16254 log.cc:1196] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/6cd2beebaaaa4b05b5f96e0b487fd934
I20260809 00:48:08.864181 16254 ts_tablet_manager.cc:1939] T 6cd2beebaaaa4b05b5f96e0b487fd934 P 2b519e17c227420aa19ba3df9a310c5c: Deleting consensus metadata
I20260809 00:48:08.866199 15434 catalog_manager.cc:4841] TS 2b519e17c227420aa19ba3df9a310c5c (127.28.92.130:36317): tablet 6cd2beebaaaa4b05b5f96e0b487fd934 (table test-table [id=7eb3db6a06a24ef1a29cd8ea7516ae2c]) successfully deleted
I20260809 00:48:08.867895 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.822576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52272 (local address 127.28.92.129:34639)
0809 00:48:08.822755 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.822763 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.830434 (+ 7671us) server_negotiation.cc:407] Connection header received
0809 00:48:08.830814 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.830821 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.830914 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.831004 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:08.832985 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.834319 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.845812 (+ 11493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.846436 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.846518 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:08.857951 (+ 11433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:08.857969 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:08.857989 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:08.858049 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:08.863534 (+ 5485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:08.864758 (+ 1224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:08.864776 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:08.864780 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:08.865039 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:08.865628 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:08.865634 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:08.865637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:08.866347 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:08.866800 (+ 453us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:08.866987 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 00:48:08.867306 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 00:48:08.868907 15772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:08.963436 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 15578
I20260809 00:48:08.991631 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 15788
Aug 09 00:48:08 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:48:09.010293 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:08.992413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.28.92.130:36317)
0809 00:48:08.992730 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:08.992737 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:08.992762 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:48:08.992838 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:08.992845 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:08.992935 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:08.993057 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:08.994355 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.995794 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.997163 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:08.998209 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:08.998371 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:09.002637 (+ 4266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:09.002661 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:09.002686 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:09.002801 (+ 115us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:09.006893 (+ 4092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:09.007666 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:09.007678 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:09.007682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:09.007871 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:09.008293 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:09.008299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:09.008303 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:09.008856 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:09.009189 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:09.009489 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 00:48:09.009822 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260809 00:48:09.011063 15986 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:09.122936 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 15788
I20260809 00:48:09.145113 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 16006
Aug 09 00:48:09 dist-test-slave-t7g5 krb5kdc[14759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:48:09.163201 16210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:09.145891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33416 (local address 127.28.92.131:39597)
0809 00:48:09.146069 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:09.146074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:09.146139 (+ 65us) server_negotiation.cc:407] Connection header received
0809 00:48:09.146364 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:09.146368 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:09.146467 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:09.146552 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:09.148399 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:09.149203 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:09.151089 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:09.151549 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:09.151644 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:09.156895 (+ 5251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:09.156908 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:09.156924 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:09.156965 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:09.160218 (+ 3253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:09.160897 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:09.160904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:09.160906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:09.161066 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:09.161441 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:09.161444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:09.161447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:09.161985 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:09.162308 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:09.162622 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 00:48:09.162847 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 00:48:09.163918 16182 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:09.284078 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 16006
I20260809 00:48:09.309585 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 15407
I20260809 00:48:09.310828 15502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:09.422297 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 15407
I20260809 00:48:09.451805 29042 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 00:48:09.795593 29042 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 00:48:09.795915 29042 mini_ranger.cc:66] Stopping Ranger...
I20260809 00:48:10.141115 29042 mini_ranger.cc:68] Stopped Ranger
2026-08-09 00:48:10.141 UTC [14805] LOG: received smart shutdown request
2026-08-09 00:48:10.145 UTC [14805] LOG: background worker "logical replication launcher" (PID 14821) exited with exit code 1
2026-08-09 00:48:10.145 UTC [14814] LOG: shutting down
2026-08-09 00:48:10.290 UTC [14805] LOG: database system is shut down
2026-08-09T00:48:10Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50605 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:48:10 dist-test-slave-t7g5 krb5kdc[16276](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:48:10 dist-test-slave-t7g5 krb5kdc[16276](info): set up 2 sockets
Aug 09 00:48:10 dist-test-slave-t7g5 krb5kdc[16276](info): commencing operation
krb5kdc: starting...
W20260809 00:48:11.659584 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.008s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:48:11 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:48:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:48:11Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/rangeradmin_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/rangeradmin_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/rangerlookup_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/rangerlookup_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
I20260809 00:48:12.016423 29042 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksLdMAp/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/postgres -l logfile start
2026-08-09 00:48:14.350 UTC [16327] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 00:48:14.350 UTC [16327] LOG: listening on IPv4 address "127.28.92.148", port 33393
2026-08-09 00:48:14.353 UTC [16327] LOG: listening on Unix socket "/tmp/.s.PGSQL.33393"
2026-08-09 00:48:14.376 UTC [16332] LOG: database system was shut down at 2026-08-09 00:48:13 UTC
2026-08-09 00:48:14.379 UTC [16327] LOG: database system is ready to accept connections
I20260809 00:48:15.467289 29042 mini_postgres.cc:96] Postgres bound to 33393
2026-08-09 00:48:15.488 UTC [16344] FATAL: database "slave" does not exist
127.28.92.148:33393 - accepting connections
I20260809 00:48:15.488763 29042 mini_ranger.cc:161] Starting Ranger...
I20260809 00:48:15.516930 29042 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 00:48:15.979763 29042 mini_ranger.cc:87] Created ranger Postgres database
I20260809 00:48:15.979895 29042 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-admin
2026-08-09 00:48:16,273 [I] DB FLAVOR :POSTGRES
2026-08-09 00:48:16,274 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 00:48:16,274 [I] Checking connection..
2026-08-09 00:48:16,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 00:48:16,566 [I] Checking connection passed.
2026-08-09 00:48:16,566 [I] --------- Verifying version history table ---------
2026-08-09 00:48:16,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 00:48:16,841 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 00:48:16,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 00:48:17,084 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 00:48:17,084 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 00:48:17,084 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 00:48:17.322 UTC [16439] WARNING: there is no transaction in progress
2026-08-09 00:48:17,331 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 00:48:17,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 00:48:17,597 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 00:48:17,597 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 00:48:17,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 00:48:17,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 00:48:18,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t7g5.c.gcp-upstream.internal','N') ;"
2026-08-09 00:48:18,342 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 00:48:18,589 [I] Table x_portal_user does not exist in database ranger
2026-08-09 00:48:18,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 00:48:18,853 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 00:48:18,853 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 00:48:19,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 00:48:19,344 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 00:48:19,344 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 00:48:20.314 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.330 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.345 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.359 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.378 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.396 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.451 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.457 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.471 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.480 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.490 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.503 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.513 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.519 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.525 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:20.531 UTC [16606] WARNING: there is no transaction in progress
2026-08-09 00:48:21,124 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 00:48:21,125 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 00:48:21,375 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 00:48:21,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 00:48:21,632 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 00:48:21,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 00:48:21,900 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 00:48:21,901 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 00:48:22,165 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 00:48:22,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t7g5.c.gcp-upstream.internal';"
2026-08-09 00:48:22,675 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 00:48:22,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 00:48:22,919 [I] DB_PATCHES have already been applied
I20260809 00:48:22.926067 29042 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksLdMAp/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 00:48:22.926158 29042 mini_ranger.cc:193] Using host: 127.28.92.148
I20260809 00:48:22.944531 29042 mini_ranger.cc:227] Ranger admin URL: http://127.28.92.148:52077
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 12:48:23 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 00:48:24.247677 29042 mini_ranger.cc:160] Time spent starting Ranger: real 8.759s user 0.003s sys 0.051s
Aug 09, 2026 12:48:44 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 12:48:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 09, 2026 12:48:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 12:48:44 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 12:48:45 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 00:48:45.977172 29042 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.28.92.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.28.92.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/rangerkms_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.28.92.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/rangerkms_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.28.92.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.28.92.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.28.92.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/HTTP_127.28.92.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 00:48:46 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236526, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 00:48:46.164436 29042 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 00:48:46.192286 29042 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 00:48:46.976791 29042 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 00:48:46.976907 29042 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms
I20260809 00:48:46.976946 29042 mini_ranger_kms.cc:227] Using postgres at 127.28.92.148:33393
2026-08-09 00:48:47,313 [I] DB FLAVOR :POSTGRES
2026-08-09 00:48:47,313 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 00:48:47,314 [I] Checking connection
2026-08-09 00:48:47,314 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 00:48:47,558 [I] connection success
2026-08-09 00:48:47,558 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 00:48:47,558 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 00:48:47,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 00:48:47,809 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 00:48:47,809 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 00:48:47,809 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 00:48:47,809 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.28.92.148:33393/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 00:48:48,067 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 00:48:48.534081 29042 mini_ranger_kms.cc:310] Created kms service
I20260809 00:48:48.710458 29042 mini_ranger_kms.cc:326] Created kudu user
I20260809 00:48:48.752544 29042 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 00:48:48 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236526, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:49.160856 29042 mini_ranger_kms.cc:384] Added ranger policy
I20260809 00:48:49.161213 29042 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksLdMAp/build/asan/bin/postgresql.jar:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksLdMAp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 00:48:49.161293 29042 mini_ranger_kms.cc:240] Using host: 127.28.92.148
I20260809 00:48:49.187532 29042 mini_ranger_kms.cc:276] Ranger KMS PID: 16881
I20260809 00:48:49.187655 29042 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.28.92.148:41991
Aug 09, 2026 12:48:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 12:48:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 12:48:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 12:48:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 12:48:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 12:48:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 00:48:51 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786236531, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.92.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:51.727494 29042 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.563s user 0.070s sys 0.301s
I20260809 00:48:51.727753 29042 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 00:48:51.727941 29042 mini_ranger_kms.cc:401] 127.28.92.148:41991/kms/v1/keys
Aug 09 00:48:51 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236531, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.92.148@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
Aug 09 00:48:52 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236531, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.28.92.148@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
Aug 09 00:48:54 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:48:54.493381 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43475
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:43475
--ranger_config_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:48:54.849902 16956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:54.850194 16956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:54.850291 16956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:54.857625 16956 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:48:54.857784 16956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:54.857838 16956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:54.857903 16956 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:48:54.857949 16956 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:48:54.868383 16956 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
--ranger_kms_url=127.28.92.148:41991/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:43475
--ranger_config_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:54.869768 16956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:54.871393 16956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:54.883760 16964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:54.883737 16969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:54.883704 16966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:54.883977 16956 server_base.cc:1034] running on GCE node
I20260809 00:48:54.885229 16956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:54.886708 16956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:54.887935 16956 hybrid_clock.cc:648] HybridClock initialized: now 1786236534887890 us; error 33 us; skew 500 ppm
I20260809 00:48:54.888306 16956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:54 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:54.891373 16956 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:48:54.892876 16956 webserver.cc:460] Webserver started at http://127.28.92.190:39681/ using document root <none> and password file <none>
I20260809 00:48:54.893499 16956 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:54.893608 16956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:54.893952 16956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:54 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:54.959786 16956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "db50fa2a8610452db2aebde83e541f65"
format_stamp: "Formatted at 2026-08-09 00:48:54 on dist-test-slave-t7g5"
server_key: "42b40e4753dc0f127a94c2e28717a944"
server_key_iv: "438144adffc951cfc4e822eb0122838a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:54.960655 16956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "db50fa2a8610452db2aebde83e541f65"
format_stamp: "Formatted at 2026-08-09 00:48:54 on dist-test-slave-t7g5"
server_key: "42b40e4753dc0f127a94c2e28717a944"
server_key_iv: "438144adffc951cfc4e822eb0122838a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:54.966152 16956 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:48:54.985890 16981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:54.987366 16956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:48:54.987557 16956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "db50fa2a8610452db2aebde83e541f65"
format_stamp: "Formatted at 2026-08-09 00:48:54 on dist-test-slave-t7g5"
server_key: "42b40e4753dc0f127a94c2e28717a944"
server_key_iv: "438144adffc951cfc4e822eb0122838a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:54.987777 16956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:55.014204 16956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:55.018641 16956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:55.018976 16956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:55.038271 16956 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:43475
I20260809 00:48:55.038220 17061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:43475 every 8 connection(s)
I20260809 00:48:55.039687 16956 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:48:55.043663 17065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:48:55.045745 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 16956
I20260809 00:48:55.045967 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:48:55.046780 29042 external_mini_cluster.cc:1428] Setting key 689e246d79f6253850bee8c8ad3d836e
I20260809 00:48:55.058300 17065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Bootstrap starting.
I20260809 00:48:55.063025 17065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Neither blocks nor log segments found. Creating new log.
I20260809 00:48:55.064420 17065 log.cc:824] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Log is configured to *not* fsync() on all Append() calls
I20260809 00:48:55.067684 17065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: No bootstrap required, opened a new log
I20260809 00:48:55.077257 17065 raft_consensus.cc:348] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:55.077962 17065 raft_consensus.cc:374] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:48:55.078137 17065 raft_consensus.cc:729] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db50fa2a8610452db2aebde83e541f65, State: Initialized, Role: FOLLOWER
Aug 09 00:48:55 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:55.078878 17065 consensus_queue.cc:260] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:55.079229 17065 raft_consensus.cc:388] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:48:55.079383 17065 raft_consensus.cc:482] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:48:55.079573 17065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:48:55.082242 17065 raft_consensus.cc:504] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:55.082834 17065 leader_election.cc:302] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db50fa2a8610452db2aebde83e541f65; no voters:
I20260809 00:48:55.083527 17065 leader_election.cc:288] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:48:55.083658 17072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:48:55.090204 17069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:55.049148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.28.92.190:43475)
0809 00:48:55.063870 (+ 14722us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:55.063888 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:55.063940 (+ 52us) server_negotiation.cc:407] Connection header received
0809 00:48:55.066508 (+ 2568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:55.066541 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:55.067052 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:55.067508 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:55.069273 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:55.071475 (+ 2202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:55.073443 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:55.074638 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:55.074842 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:55.080093 (+ 5251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:55.080103 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:55.080124 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:55.080177 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:55.084343 (+ 4166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:55.085286 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:55.085296 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:55.085306 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:55.085498 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:55.085994 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:55.085999 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:55.086002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:55.086811 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:55.088042 (+ 1231us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:55.088340 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 00:48:55.088783 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14443,"thread_start_us":15352,"threads_started":1}
I20260809 00:48:55.092720 17065 sys_catalog.cc:564] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:48:55.093945 17072 raft_consensus.cc:686] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 LEADER]: Becoming Leader. State: Replica: db50fa2a8610452db2aebde83e541f65, State: Running, Role: LEADER
I20260809 00:48:55.094594 17072 consensus_queue.cc:237] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:55.097635 17077 sys_catalog.cc:455] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db50fa2a8610452db2aebde83e541f65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } } }
I20260809 00:48:55.098837 17077 sys_catalog.cc:458] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: This master's current role is: LEADER
I20260809 00:48:55.103688 17079 sys_catalog.cc:455] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db50fa2a8610452db2aebde83e541f65. Latest consensus state: current_term: 1 leader_uuid: "db50fa2a8610452db2aebde83e541f65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } } }
I20260809 00:48:55.105945 17079 sys_catalog.cc:458] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: This master's current role is: LEADER
I20260809 00:48:55.115026 17083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:48:55.121141 17083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:48:55.145306 17083 catalog_manager.cc:1347] Generated new cluster ID: 8c501517e393489890f4c80100d26969
I20260809 00:48:55.145462 17083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:48:55.162654 17065 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 00:48:55.164444 17083 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:48:55.173019 17083 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:48:55.184623 17083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Generated new TSK 0
I20260809 00:48:55.185879 17083 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:48:55.973793 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43475
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:48:56 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786236536, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 00:48:56.449204 17135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:56.449677 17135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:56.449976 17135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:56.461511 17135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:56.461864 17135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:56.462146 17135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:48:56.478361 17135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.28.92.148:41991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:56.480335 17135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:56.482317 17135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:56.503768 17155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:56.504719 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:56.510339 17135 server_base.cc:1034] running on GCE node
W20260809 00:48:56.511091 17160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:56.512022 17135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:56.513383 17135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:56.514684 17135 hybrid_clock.cc:648] HybridClock initialized: now 1786236536514605 us; error 63 us; skew 500 ppm
I20260809 00:48:56.515122 17135 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:56 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236536, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:56.519578 17135 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:48:56.527146 17135 webserver.cc:460] Webserver started at http://127.28.92.129:44923/ using document root <none> and password file <none>
I20260809 00:48:56.528252 17135 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:56.528431 17135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:56.528855 17135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:56 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236536, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:56.549158 17135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "7ea60b51df7247b7ade331536f3834f8"
format_stamp: "Formatted at 2026-08-09 00:48:56 on dist-test-slave-t7g5"
server_key: "6f2102b39646a832df06fc4f09aa1d7b"
server_key_iv: "165a1b826d5f564269ec7fc6cabd9ef1"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:56.551352 17135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "7ea60b51df7247b7ade331536f3834f8"
format_stamp: "Formatted at 2026-08-09 00:48:56 on dist-test-slave-t7g5"
server_key: "6f2102b39646a832df06fc4f09aa1d7b"
server_key_iv: "165a1b826d5f564269ec7fc6cabd9ef1"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:56.559128 17135 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260809 00:48:56.583225 17171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:56.585109 17135 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260809 00:48:56.585304 17135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "7ea60b51df7247b7ade331536f3834f8"
format_stamp: "Formatted at 2026-08-09 00:48:56 on dist-test-slave-t7g5"
server_key: "6f2102b39646a832df06fc4f09aa1d7b"
server_key_iv: "165a1b826d5f564269ec7fc6cabd9ef1"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:56.585578 17135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:56.601805 17135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:56.606107 17135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:56.606537 17135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:56.612025 17135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:56.614523 17135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:56.614681 17135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 00:48:56.614833 17135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:56.614902 17135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:56.687408 17135 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:35423
I20260809 00:48:56.687420 17348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:35423 every 8 connection(s)
I20260809 00:48:56.688841 17135 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:48:56.696766 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 17135
I20260809 00:48:56.697007 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:48:56.697903 29042 external_mini_cluster.cc:1428] Setting key 450b2899bc6c8218f52cd66523803751
Aug 09 00:48:56 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236536, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:56.738495 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:56.694018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:53639 (local address 127.28.92.190:43475)
0809 00:48:56.719308 (+ 25290us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:56.719315 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:56.719337 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:48:56.719406 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:56.719411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:56.719486 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:56.719591 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:56.721756 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:56.722829 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:56.725068 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:56.725622 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:56.725758 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:56.730094 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:56.730100 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:56.730105 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:56.730142 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:56.733372 (+ 3230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:56.734335 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:56.734341 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:56.734345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:56.734510 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:56.735051 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:56.735056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:56.735058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:56.735419 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:56.735597 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:56.737888 (+ 2291us) server_negotiation.cc:299] Negotiation successful
0809 00:48:56.738158 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25152,"thread_start_us":25691,"threads_started":1}
I20260809 00:48:56.739480 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:56.692724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43475 (local address 127.28.92.129:53639)
0809 00:48:56.716182 (+ 23458us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:56.716237 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:56.718456 (+ 2219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:56.719916 (+ 1460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:56.719931 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:56.720613 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:56.721510 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:56.721539 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:56.723022 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:56.723028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:56.724887 (+ 1859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:56.724902 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:56.726063 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:56.726070 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:56.726354 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:56.727155 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:56.727185 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:56.729831 (+ 2646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:56.733548 (+ 3717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:56.733557 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:56.733575 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:56.734192 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:56.734635 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:56.734640 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:56.734644 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:56.734913 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:56.735631 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:56.735639 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:56.736070 (+ 431us) client_negotiation.cc:769] Sending connection context
0809 00:48:56.736366 (+ 296us) client_negotiation.cc:240] Negotiation successful
0809 00:48:56.737005 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23150,"thread_start_us":25114,"threads_started":1}
I20260809 00:48:56.741562 17349 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43475
I20260809 00:48:56.741922 17349 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:56.742794 17349 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:48:56.745355 17006 ts_manager.cc:194] Registered new tserver with Master: 7ea60b51df7247b7ade331536f3834f8 (127.28.92.129:35423)
I20260809 00:48:56.747401 17006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:53639
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Aug 09 00:48:56 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236536, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:48:56.800848 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43475
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:48:57 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236536, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
W20260809 00:48:57.280591 17357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:57.281100 17357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:57.281261 17357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:57.292631 17357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:57.292856 17357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:57.293102 17357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:48:57.306802 17357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.28.92.148:41991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:57.308519 17357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:57.310376 17357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:57.325906 17376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:57.326414 17377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:57.326741 17379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:57.326903 17357 server_base.cc:1034] running on GCE node
I20260809 00:48:57.327664 17357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:57.328878 17357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:57.330127 17357 hybrid_clock.cc:648] HybridClock initialized: now 1786236537330039 us; error 71 us; skew 500 ppm
I20260809 00:48:57.330531 17357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:57 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236537, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:57.334244 17357 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:48:57.335707 17357 webserver.cc:460] Webserver started at http://127.28.92.130:42401/ using document root <none> and password file <none>
I20260809 00:48:57.336378 17357 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:57.336491 17357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:57.336796 17357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:57 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236537, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:57.354635 17357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "1c470626bcc1403694e03c02d6fa0c8b"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "9f0f45f0d804e2a25c44cfb5b34fdd28"
server_key_iv: "039e471233e3e375f6fbd810e4452c45"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:57.355471 17357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "1c470626bcc1403694e03c02d6fa0c8b"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "9f0f45f0d804e2a25c44cfb5b34fdd28"
server_key_iv: "039e471233e3e375f6fbd810e4452c45"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:57.361060 17357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 00:48:57.377324 17389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:57.379061 17357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:48:57.379235 17357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "1c470626bcc1403694e03c02d6fa0c8b"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "9f0f45f0d804e2a25c44cfb5b34fdd28"
server_key_iv: "039e471233e3e375f6fbd810e4452c45"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:57.379457 17357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:57.392210 17357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:57.396212 17357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:57.396485 17357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:57.397446 17357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:57.398880 17357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:57.398962 17357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:57.399080 17357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:57.399133 17357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:57.431545 17357 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:32801
I20260809 00:48:57.431563 17559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:32801 every 8 connection(s)
I20260809 00:48:57.432866 17357 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:48:57.436928 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 17357
I20260809 00:48:57.437086 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:48:57.437750 29042 external_mini_cluster.cc:1428] Setting key b5256fdaf22ec888766ee59f9965f702
Aug 09 00:48:57 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236537, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:57.456712 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:57.435580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:37147 (local address 127.28.92.190:43475)
0809 00:48:57.436093 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:57.436100 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:57.437756 (+ 1656us) server_negotiation.cc:407] Connection header received
0809 00:48:57.439191 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:57.439197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:57.439309 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:57.439434 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:57.441274 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:57.442356 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:57.444411 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:57.445026 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:57.445145 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:57.449473 (+ 4328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:57.449479 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:57.449482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:57.449521 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:57.453534 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:57.454325 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:57.454331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:57.454335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:57.454476 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:57.454899 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:57.454903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:57.454905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:57.455223 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:57.455381 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:57.456066 (+ 685us) server_negotiation.cc:299] Negotiation successful
0809 00:48:57.456307 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":245,"threads_started":1}
I20260809 00:48:57.457966 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:57.436100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43475 (local address 127.28.92.130:37147)
0809 00:48:57.436971 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:57.437024 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:57.438893 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:57.439700 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:57.439711 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:57.440255 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:57.441087 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:57.441112 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:57.442540 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:57.442545 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:57.444259 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:57.444273 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:57.445252 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:57.445260 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:57.445556 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:57.446329 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:57.446371 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:57.449181 (+ 2810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:57.453713 (+ 4532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:57.453723 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:57.453741 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:57.454202 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:57.454585 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:57.454589 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:57.454591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:57.454769 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:57.455348 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:57.455356 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:57.455699 (+ 343us) client_negotiation.cc:769] Sending connection context
0809 00:48:57.455942 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 00:48:57.456490 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":325,"threads_started":1}
I20260809 00:48:57.459460 17561 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43475
I20260809 00:48:57.459767 17561 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:57.460469 17561 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:48:57.461946 17006 ts_manager.cc:194] Registered new tserver with Master: 1c470626bcc1403694e03c02d6fa0c8b (127.28.92.130:32801)
I20260809 00:48:57.462742 17006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:37147
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:48:57.510659 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43475
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:48:57.751235 17349 heartbeater.cc:503] Master 127.28.92.190:43475 was elected leader, sending a full tablet report...
W20260809 00:48:57.868950 17570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:57.869231 17570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:57.869372 17570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:57.876603 17570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:57.876724 17570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:57.876876 17570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:48:57.887111 17570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.28.92.148:41991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:57.888401 17570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:57.889748 17570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:57.903239 17575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:57.903185 17578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:57.903160 17576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:57.904134 17570 server_base.cc:1034] running on GCE node
I20260809 00:48:57.904743 17570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:57.905735 17570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:57.906944 17570 hybrid_clock.cc:648] HybridClock initialized: now 1786236537906874 us; error 53 us; skew 500 ppm
I20260809 00:48:57.907255 17570 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:57 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236537, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:57.910377 17570 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:48:57.911791 17570 webserver.cc:460] Webserver started at http://127.28.92.131:35277/ using document root <none> and password file <none>
I20260809 00:48:57.912448 17570 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:57.912554 17570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:48:57.912817 17570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 00:48:57 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236537, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:57.926939 17570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "50bcb92e50824f45902806f1e87e84a0"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "1b062859e5bd624aa5ca9b0108d9e383"
server_key_iv: "f93fedd90f01a38845c718a365c332f5"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:57.927793 17570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "50bcb92e50824f45902806f1e87e84a0"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "1b062859e5bd624aa5ca9b0108d9e383"
server_key_iv: "f93fedd90f01a38845c718a365c332f5"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:57.933377 17570 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:48:57.947628 17587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:57.949024 17570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:48:57.949196 17570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "50bcb92e50824f45902806f1e87e84a0"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "1b062859e5bd624aa5ca9b0108d9e383"
server_key_iv: "f93fedd90f01a38845c718a365c332f5"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:57.949414 17570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:57.964313 17570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:57.968214 17570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:57.968505 17570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:57.969426 17570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:57.970806 17570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:57.970889 17570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:57.971019 17570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:57.971081 17570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:58.001565 17570 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:42867
I20260809 00:48:58.001605 17752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:42867 every 8 connection(s)
I20260809 00:48:58.002882 17570 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:48:58.003382 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 17570
I20260809 00:48:58.003546 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:48:58.004262 29042 external_mini_cluster.cc:1428] Setting key 312c0273cf9748608fe0b12b22f3c9a9
Aug 09 00:48:58 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236537, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:58.022529 17757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:58.005687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:41193 (local address 127.28.92.190:43475)
0809 00:48:58.006588 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:58.006595 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:58.007444 (+ 849us) server_negotiation.cc:407] Connection header received
0809 00:48:58.009211 (+ 1767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:58.009215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:58.009280 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:58.009368 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:58.010789 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.011508 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.012948 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.013354 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.013442 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:58.016618 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:58.016623 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:58.016626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:58.016671 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:58.019746 (+ 3075us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.020498 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.020503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.020505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.020634 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.021059 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.021062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.021064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.021320 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:58.021429 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:58.022095 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 00:48:58.022265 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":622,"threads_started":1}
I20260809 00:48:58.023514 17758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:58.006455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43475 (local address 127.28.92.131:41193)
0809 00:48:58.007296 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:58.007342 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:58.008976 (+ 1634us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:58.009571 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:58.009579 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:58.010034 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:58.010621 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:58.010639 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.011621 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.011625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:58.012841 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:58.012853 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.013524 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.013528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:58.013765 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:58.014348 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:58.014369 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:58.016411 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:58.019885 (+ 3474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:58.019894 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:58.019909 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:58.020387 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:58.020770 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:58.020774 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:58.020777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:58.020969 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:58.021429 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:58.021435 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:58.021773 (+ 338us) client_negotiation.cc:769] Sending connection context
0809 00:48:58.022014 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 00:48:58.022402 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":343,"threads_started":1}
I20260809 00:48:58.024951 17753 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43475
I20260809 00:48:58.025279 17753 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:58.026037 17753 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:48:58.027406 17006 ts_manager.cc:194] Registered new tserver with Master: 50bcb92e50824f45902806f1e87e84a0 (127.28.92.131:42867)
I20260809 00:48:58.028203 17006 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:41193
I20260809 00:48:58.032059 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:48:58.033771 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 17135
Aug 09 00:48:58 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:48:58.052765 17761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:58.034559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40064 (local address 127.28.92.129:35423)
0809 00:48:58.035100 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:58.035106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:58.035130 (+ 24us) server_negotiation.cc:407] Connection header received
0809 00:48:58.035185 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:58.035190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:58.035366 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:58.035496 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:58.036917 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.038359 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.040538 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.041280 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.041403 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:58.046670 (+ 5267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:58.046685 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:58.046704 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:58.046747 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:58.049728 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.050555 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.050562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.050564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.050704 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.051084 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.051087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.051089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.051579 (+ 490us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:58.051960 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:58.052122 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 00:48:58.052354 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":260,"threads_started":1}
I20260809 00:48:58.054316 17341 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:58.148123 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 17135
I20260809 00:48:58.167289 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 17357
Aug 09 00:48:58 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:48:58.183589 17764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:58.168256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.28.92.130:32801)
0809 00:48:58.168874 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:58.168881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:58.168905 (+ 24us) server_negotiation.cc:407] Connection header received
0809 00:48:58.168963 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:58.168970 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:58.169175 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:58.169347 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:58.170654 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.171643 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.172994 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.173538 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.173679 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:58.178135 (+ 4456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:58.178146 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:58.178159 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:58.178195 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:58.180639 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.181690 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.181700 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.181704 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.181884 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.182251 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.182254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.182256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.182591 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:58.182807 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:58.183078 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 00:48:58.183290 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":320,"threads_started":1}
I20260809 00:48:58.184903 17551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:58.268374 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 17357
I20260809 00:48:58.293349 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 17570
Aug 09 00:48:58 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236534, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:48:58.309249 17766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:58.294388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45582 (local address 127.28.92.131:42867)
0809 00:48:58.295057 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:58.295063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:58.295094 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:48:58.295155 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:58.295162 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:58.295381 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:58.295524 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:58.296864 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.298029 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.299284 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:58.299818 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:58.299911 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:58.303927 (+ 4016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:58.303939 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:58.303953 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:58.303989 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:58.306624 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.307213 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.307220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.307222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.307347 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:58.307620 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:58.307623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:58.307625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:58.308017 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:58.308345 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:58.308627 (+ 282us) server_negotiation.cc:299] Negotiation successful
0809 00:48:58.308899 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":349,"threads_started":1}
I20260809 00:48:58.310552 17747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:58.391458 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 17570
I20260809 00:48:58.410488 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 16956
I20260809 00:48:58.411789 17056 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:48:58.517848 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 16956
I20260809 00:48:58.550202 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43475
--webserver_interface=127.28.92.190
--webserver_port=39681
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:43475
--ranger_config_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:48:58.922057 17777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:58.922380 17777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:58.922477 17777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:58.929632 17777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:48:58.929803 17777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:58.929862 17777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:58.929917 17777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:48:58.929965 17777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:48:58.940158 17777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:43475
--ranger_config_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=39681
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:58.941417 17777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:58.942788 17777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:58.953985 17786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:58.954030 17784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:58.954058 17789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:58.955083 17777 server_base.cc:1034] running on GCE node
I20260809 00:48:58.955829 17777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:58.957105 17777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:58.958321 17777 hybrid_clock.cc:648] HybridClock initialized: now 1786236538958276 us; error 39 us; skew 500 ppm
I20260809 00:48:58.958654 17777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:58 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236538, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:58.961584 17777 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:48:58.963006 17777 webserver.cc:460] Webserver started at http://127.28.92.190:39681/ using document root <none> and password file <none>
I20260809 00:48:58.963630 17777 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:58.963749 17777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 00:48:58 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236538, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:59.003400 17777 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 00:48:59.006556 17799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:59.007988 17777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:48:59.008165 17777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "db50fa2a8610452db2aebde83e541f65"
format_stamp: "Formatted at 2026-08-09 00:48:54 on dist-test-slave-t7g5"
server_key: "42b40e4753dc0f127a94c2e28717a944"
server_key_iv: "438144adffc951cfc4e822eb0122838a"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:59.009127 17777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:59.025688 17777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:59.029783 17777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:59.030072 17777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:59.048027 17777 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:43475
I20260809 00:48:59.048048 17873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:43475 every 8 connection(s)
I20260809 00:48:59.049521 17777 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:48:59.055913 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 17777
I20260809 00:48:59.056525 17874 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:48:59.056802 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:35423
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:43475
--webserver_port=44923
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:48:59.059816 17874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Bootstrap starting.
I20260809 00:48:59.078091 17874 log.cc:824] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Log is configured to *not* fsync() on all Append() calls
I20260809 00:48:59.086884 17874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:48:59.087396 17874 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Bootstrap complete.
I20260809 00:48:59.096029 17874 raft_consensus.cc:348] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:59.096863 17874 raft_consensus.cc:729] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: db50fa2a8610452db2aebde83e541f65, State: Initialized, Role: FOLLOWER
I20260809 00:48:59.097471 17874 consensus_queue.cc:260] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:59.097718 17874 raft_consensus.cc:388] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:48:59.097836 17874 raft_consensus.cc:482] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:48:59.098002 17874 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 1 FOLLOWER]: Advancing to term 2
I20260809 00:48:59.101629 17874 raft_consensus.cc:504] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:59.102145 17874 leader_election.cc:302] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db50fa2a8610452db2aebde83e541f65; no voters:
I20260809 00:48:59.102747 17874 leader_election.cc:288] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 00:48:59.102973 17880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 00:48:59.103953 17880 raft_consensus.cc:686] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [term 2 LEADER]: Becoming Leader. State: Replica: db50fa2a8610452db2aebde83e541f65, State: Running, Role: LEADER
I20260809 00:48:59.104666 17874 sys_catalog.cc:564] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:48:59.104614 17880 consensus_queue.cc:237] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } }
I20260809 00:48:59.107152 17882 sys_catalog.cc:455] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db50fa2a8610452db2aebde83e541f65. Latest consensus state: current_term: 2 leader_uuid: "db50fa2a8610452db2aebde83e541f65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } } }
I20260809 00:48:59.107547 17882 sys_catalog.cc:458] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: This master's current role is: LEADER
I20260809 00:48:59.108083 17881 sys_catalog.cc:455] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "db50fa2a8610452db2aebde83e541f65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db50fa2a8610452db2aebde83e541f65" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43475 } } }
I20260809 00:48:59.108369 17881 sys_catalog.cc:458] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65 [sys.catalog]: This master's current role is: LEADER
I20260809 00:48:59.115517 17889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:48:59.121351 17889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:48:59.122931 17889 catalog_manager.cc:1259] Loaded cluster ID: 8c501517e393489890f4c80100d26969
I20260809 00:48:59.123091 17889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:48:59.127257 17889 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:48:59.128829 17889 catalog_manager.cc:5879] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Loaded TSK: 0
I20260809 00:48:59.130510 17889 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:48:59.132700 17874 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 00:48:59.506804 17876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:48:59.507282 17876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:48:59.507483 17876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:48:59.518288 17876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:48:59.518514 17876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:48:59.518759 17876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:48:59.532061 17876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:35423
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=44923
--tserver_master_addrs=127.28.92.190:43475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:48:59.533595 17876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:48:59.535089 17876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:48:59.561966 17936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:59.562323 17937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:48:59.565996 17940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:48:59.566486 17876 server_base.cc:1034] running on GCE node
I20260809 00:48:59.567584 17876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:48:59.571702 17876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:48:59.575143 17876 hybrid_clock.cc:648] HybridClock initialized: now 1786236539575081 us; error 42 us; skew 500 ppm
I20260809 00:48:59.575511 17876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:48:59 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236539, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:48:59.579026 17876 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:48:59.580790 17876 webserver.cc:460] Webserver started at http://127.28.92.129:44923/ using document root <none> and password file <none>
I20260809 00:48:59.581540 17876 fs_manager.cc:359] Metadata directory not provided
I20260809 00:48:59.581719 17876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 00:48:59 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236539, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:48:59.603912 17876 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 00:48:59.626021 17952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:59.627830 17876 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.006s sys 0.012s
I20260809 00:48:59.628027 17876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "7ea60b51df7247b7ade331536f3834f8"
format_stamp: "Formatted at 2026-08-09 00:48:56 on dist-test-slave-t7g5"
server_key: "6f2102b39646a832df06fc4f09aa1d7b"
server_key_iv: "165a1b826d5f564269ec7fc6cabd9ef1"
server_key_version: "kuduclusterkey@0"
I20260809 00:48:59.629082 17876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:48:59.660068 17876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:48:59.666313 17876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:48:59.666667 17876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:48:59.667994 17876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:48:59.669912 17876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:48:59.670085 17876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:59.670234 17876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:48:59.670351 17876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:48:59.723744 17876 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:35423
I20260809 00:48:59.723759 18123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:35423 every 8 connection(s)
I20260809 00:48:59.725678 17876 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:48:59.729518 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 17876
I20260809 00:48:59.730405 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:32801
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:43475
--webserver_port=42401
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:48:59 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236539, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:48:59.756201 18127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:59.730464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:41697 (local address 127.28.92.190:43475)
0809 00:48:59.733547 (+ 3083us) server_negotiation.cc:206] Beginning negotiation
0809 00:48:59.733566 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 00:48:59.733619 (+ 53us) server_negotiation.cc:407] Connection header received
0809 00:48:59.734868 (+ 1249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:48:59.734886 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:48:59.735350 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:48:59.735791 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:48:59.739749 (+ 3958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:59.741929 (+ 2180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:59.743771 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:48:59.744516 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:48:59.744690 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:59.747964 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:48:59.747973 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:48:59.747987 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:48:59.748026 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:48:59.751728 (+ 3702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:59.752453 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:59.752460 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:59.752473 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:59.752631 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:48:59.753071 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:48:59.753074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:48:59.753077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:48:59.753577 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:48:59.753797 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 00:48:59.754566 (+ 769us) server_negotiation.cc:299] Negotiation successful
0809 00:48:59.754937 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2812,"thread_start_us":3208,"threads_started":1}
I20260809 00:48:59.757129 18126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:48:59.729337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43475 (local address 127.28.92.129:41697)
0809 00:48:59.731574 (+ 2237us) negotiation.cc:107] Waiting for socket to connect
0809 00:48:59.731638 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0809 00:48:59.734032 (+ 2394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:48:59.738004 (+ 3972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:48:59.738016 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:48:59.738650 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:48:59.739456 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:59.739498 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:59.742137 (+ 2639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:59.742142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:59.743594 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:48:59.743609 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:48:59.744763 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:48:59.744771 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:48:59.745030 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:48:59.745702 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:48:59.745738 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:48:59.747718 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:48:59.751867 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:59.751876 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:59.751891 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:59.752304 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:59.752746 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:48:59.752751 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:48:59.752755 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:48:59.752944 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:48:59.753729 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:48:59.753736 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:48:59.754058 (+ 322us) client_negotiation.cc:769] Sending connection context
0809 00:48:59.754288 (+ 230us) client_negotiation.cc:240] Negotiation successful
0809 00:48:59.754848 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1879,"thread_start_us":1626,"threads_started":1}
I20260809 00:48:59.759949 18124 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43475
I20260809 00:48:59.760242 18124 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:59.761031 18124 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
W20260809 00:48:59.763870 18124 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:43475 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 00:48:59.764106 18124 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:59.764353 18124 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:48:59.766551 18124 heartbeater.cc:464] Registering TS with master...
I20260809 00:48:59.766824 18124 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
W20260809 00:48:59.769197 18124 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 00:49:00.118453 18128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:00.118741 18128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:00.118880 18128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:00.126287 18128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:00.126410 18128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:00.126575 18128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:49:00.137089 18128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:32801
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=42401
--tserver_master_addrs=127.28.92.190:43475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:00.138957 18128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:00.140694 18128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:00.154573 18144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:00.154767 18145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:00.155560 18148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:00.156208 18128 server_base.cc:1034] running on GCE node
I20260809 00:49:00.156946 18128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:00.158047 18128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:00.159389 18128 hybrid_clock.cc:648] HybridClock initialized: now 1786236540159328 us; error 54 us; skew 500 ppm
I20260809 00:49:00.159704 18128 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:00.164292 18128 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:49:00.167461 18128 webserver.cc:460] Webserver started at http://127.28.92.130:42401/ using document root <none> and password file <none>
I20260809 00:49:00.168167 18128 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:00.168283 18128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:49:00.198704 18128 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.005s sys 0.005s
I20260809 00:49:00.209054 18168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:00.210731 18128 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.004s
I20260809 00:49:00.210913 18128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "1c470626bcc1403694e03c02d6fa0c8b"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "9f0f45f0d804e2a25c44cfb5b34fdd28"
server_key_iv: "039e471233e3e375f6fbd810e4452c45"
server_key_version: "kuduclusterkey@0"
I20260809 00:49:00.211953 18128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:00.235149 18128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:00.240473 18128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:00.240840 18128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:00.246019 18128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:00.247927 18128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:00.248080 18128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260809 00:49:00.248229 18128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:00.248332 18128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:00.322748 18128 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:32801
I20260809 00:49:00.322798 18332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:32801 every 8 connection(s)
I20260809 00:49:00.324308 18128 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:49:00.329070 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 18128
I20260809 00:49:00.329903 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.28.92.148:41991/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:42867
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:43475
--webserver_port=35277
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:32887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:00.368929 18335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:00.327240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:49945 (local address 127.28.92.190:43475)
0809 00:49:00.344006 (+ 16766us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:00.344019 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:00.344046 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:49:00.344120 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:00.344126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:00.344218 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:00.344371 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:00.351096 (+ 6725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:00.352705 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:00.355871 (+ 3166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:00.356599 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:00.356710 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:00.361306 (+ 4596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:00.361313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:00.361317 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:00.361372 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:00.365001 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:00.366000 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:00.366006 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:00.366009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:00.366169 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:00.366729 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:00.366734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:00.366738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:00.367104 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:00.367239 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:00.368281 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0809 00:49:00.368533 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16443,"thread_start_us":16644,"threads_started":1}
I20260809 00:49:00.371434 18337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:00.327895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43475 (local address 127.28.92.130:49945)
0809 00:49:00.341021 (+ 13126us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:00.341086 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:00.343491 (+ 2405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:00.344655 (+ 1164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:00.344667 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:00.345550 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:00.350791 (+ 5241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:00.350828 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:00.352965 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:00.352970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:00.355675 (+ 2705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:00.355692 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:00.357113 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:00.357121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:00.357454 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:00.358289 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:00.358322 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:00.361008 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:00.365168 (+ 4160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:00.365178 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:00.365197 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:00.365843 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:00.366327 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:00.366332 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:00.366335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:00.366588 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:00.367337 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:00.367357 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:00.367823 (+ 466us) client_negotiation.cc:769] Sending connection context
0809 00:49:00.369248 (+ 1425us) client_negotiation.cc:240] Negotiation successful
0809 00:49:00.369881 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12803,"thread_start_us":12569,"threads_started":1}
I20260809 00:49:00.373415 18333 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43475
I20260809 00:49:00.373786 18333 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:00.374738 18333 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:49:00.377005 17827 ts_manager.cc:194] Registered new tserver with Master: 1c470626bcc1403694e03c02d6fa0c8b (127.28.92.130:32801)
I20260809 00:49:00.379227 17827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:49945
W20260809 00:49:00.750598 18339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:00.751060 18339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:00.751211 18339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:00.759524 18339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:00.759640 18339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:00.759799 18339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:49:00.769342 18124 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:00.769793 18124 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:49:00.769810 18339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:32887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.28.92.148:41991/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:42867
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=35277
--tserver_master_addrs=127.28.92.190:43475
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:00.771055 17827 ts_manager.cc:194] Registered new tserver with Master: 7ea60b51df7247b7ade331536f3834f8 (127.28.92.129:35423)
I20260809 00:49:00.771508 18339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:00.772192 17827 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:41697
I20260809 00:49:00.773185 18339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:00.791021 18350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:00.801584 18352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:00.813691 18354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:00.814685 18339 server_base.cc:1034] running on GCE node
I20260809 00:49:00.815436 18339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:49:00.816615 18339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:00.817817 18339 hybrid_clock.cc:648] HybridClock initialized: now 1786236540817766 us; error 34 us; skew 500 ppm
I20260809 00:49:00.818210 18339 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:00.822019 18339 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:49:00.825172 18339 webserver.cc:460] Webserver started at http://127.28.92.131:35277/ using document root <none> and password file <none>
I20260809 00:49:00.826004 18339 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:00.826143 18339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 00:49:00 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:49:00.855222 18339 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.003s sys 0.001s
I20260809 00:49:00.859206 18368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:00.862097 18339 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:49:00.862352 18339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "50bcb92e50824f45902806f1e87e84a0"
format_stamp: "Formatted at 2026-08-09 00:48:57 on dist-test-slave-t7g5"
server_key: "1b062859e5bd624aa5ca9b0108d9e383"
server_key_iv: "f93fedd90f01a38845c718a365c332f5"
server_key_version: "kuduclusterkey@0"
I20260809 00:49:00.863813 18339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:00.926666 18339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:00.931982 18339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:00.932358 18339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:00.933645 18339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:00.935714 18339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:00.935881 18339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:00.936033 18339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:00.936141 18339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:00.980376 18339 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:42867
I20260809 00:49:00.980454 18559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:42867 every 8 connection(s)
I20260809 00:49:00.982965 18339 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:49:00.988945 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 18339
I20260809 00:49:01.027582 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:00.989901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50948 (local address 127.28.92.190:43475)
0809 00:49:01.006654 (+ 16753us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.006659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.006678 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:49:01.006748 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.006753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.006837 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.006962 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:01.009296 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.010458 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.013950 (+ 3492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.014601 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.014729 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.018835 (+ 4106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:01.018843 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:01.018848 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:01.018890 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:01.024435 (+ 5545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.025277 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.025283 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.025286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.025431 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.025862 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.025867 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.025870 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.026217 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:01.026461 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.026806 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.027032 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16653,"thread_start_us":16196,"threads_started":1}
Aug 09 00:49:01 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:01.037086 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:00.987254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:39335 (local address 127.28.92.190:43475)
0809 00:49:01.006337 (+ 19083us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.006343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.011744 (+ 5401us) server_negotiation.cc:407] Connection header received
0809 00:49:01.014998 (+ 3254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.015004 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.015075 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.015147 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:01.017540 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.018660 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.022016 (+ 3356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.022759 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.022857 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.029597 (+ 6740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:01.029604 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:01.029609 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:01.029646 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:01.032974 (+ 3328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.033879 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.033884 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.033887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.034026 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.034610 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.034615 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.034618 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.034969 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:01.035104 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.036464 (+ 1360us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.036689 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18959,"thread_start_us":19189,"threads_started":1}
I20260809 00:49:01.039685 18562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:00.986609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43475 (local address 127.28.92.131:39335)
0809 00:49:01.011169 (+ 24560us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:01.011228 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:01.013630 (+ 2402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:01.015764 (+ 2134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:01.015776 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:01.016462 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:01.017328 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.017354 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.019746 (+ 2392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.019752 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.021825 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.021841 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.023269 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.023276 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.023573 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.024216 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:01.024254 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:01.029292 (+ 5038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:01.033128 (+ 3836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:01.033137 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:01.033155 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:01.033753 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:01.034156 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:01.034160 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:01.034163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:01.034419 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:01.035197 (+ 778us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:01.035205 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:01.035676 (+ 471us) client_negotiation.cc:769] Sending connection context
0809 00:49:01.037608 (+ 1932us) client_negotiation.cc:240] Negotiation successful
0809 00:49:01.038241 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24213,"thread_start_us":23994,"threads_started":1}
I20260809 00:49:01.041424 18560 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43475
I20260809 00:49:01.041836 18560 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:01.042726 18560 heartbeater.cc:511] Master 127.28.92.190:43475 requested a full tablet report, sending...
I20260809 00:49:01.044631 17825 ts_manager.cc:194] Registered new tserver with Master: 50bcb92e50824f45902806f1e87e84a0 (127.28.92.131:42867)
I20260809 00:49:01.045854 17825 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:39335
I20260809 00:49:01.047099 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:49:01.084245 18564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.064961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50952 (local address 127.28.92.190:43475)
0809 00:49:01.065129 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.065135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.068876 (+ 3741us) server_negotiation.cc:407] Connection header received
0809 00:49:01.069099 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.069105 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.069187 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.069274 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:01.071258 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.071983 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.073639 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.074324 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.074457 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.077373 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:01.077378 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:01.077381 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:01.077415 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:01.080891 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.081810 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.081816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.081819 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.082001 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.082523 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.082528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.082532 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.082915 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:01.083156 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.083780 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.084013 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:49:01.090641 17825 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:49:01.100446 17825 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 09 00:49:01 dist-test-slave-t7g5 krb5kdc[16276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236540, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for HTTP/127.28.92.148@KRBTEST.COM
I20260809 00:49:01.172326 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.144183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:32801 (local address 127.0.0.1:58128)
0809 00:49:01.159256 (+ 15073us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:01.159300 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:01.159513 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:01.162452 (+ 2939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:01.162461 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:01.162497 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:01.162990 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.163004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.165181 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.165188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.169088 (+ 3900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.169106 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.171337 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.171344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.171554 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.171611 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 00:49:01.171751 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 00:49:01.171958 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14783,"thread_start_us":14631,"threads_started":1}
I20260809 00:49:01.173120 18582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.144380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58128 (local address 127.28.92.130:32801)
0809 00:49:01.161376 (+ 16996us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.161387 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.161423 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:49:01.161540 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.161549 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.161870 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.162096 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:01.163242 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.164991 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.169288 (+ 4297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.170828 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.170953 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.171172 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.172602 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.172785 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16786,"thread_start_us":23892,"threads_started":1}
I20260809 00:49:01.192114 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 360f063b3b544eefa759aeaed0709073 (DEFAULT_TABLE table=test-table [id=14f14c70e21b4cd5955c22f5db3f1084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:01.195021 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360f063b3b544eefa759aeaed0709073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:01.200649 18583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.160138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:42867 (local address 127.0.0.1:45592)
0809 00:49:01.166749 (+ 6611us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:01.166773 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:01.166885 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:01.181793 (+ 14908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:01.181798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:01.181829 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:01.182172 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.182187 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.184357 (+ 2170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.184362 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.187086 (+ 2724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.187104 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.197024 (+ 9920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.197030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.197223 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.197260 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:49:01.197341 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 00:49:01.197498 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6482,"thread_start_us":6815,"threads_started":1}
I20260809 00:49:01.201483 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.160293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45592 (local address 127.28.92.131:42867)
0809 00:49:01.180488 (+ 20195us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.180497 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.180539 (+ 42us) server_negotiation.cc:407] Connection header received
0809 00:49:01.180654 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.180663 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.180969 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.181200 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:01.182387 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.184177 (+ 1790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.194824 (+ 10647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.196510 (+ 1686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.196650 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.196864 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.200927 (+ 4063us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.201104 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19976,"thread_start_us":21191,"threads_started":1}
I20260809 00:49:01.207090 18581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.186208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:35423 (local address 127.0.0.1:40080)
0809 00:49:01.186586 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:01.186606 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:01.186717 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:01.198093 (+ 11376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:01.198099 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:01.198130 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:01.198303 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.198312 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.202585 (+ 4273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.202591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.204473 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.204491 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.206365 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.206371 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.206559 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.206596 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:49:01.206689 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 00:49:01.206829 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241}
I20260809 00:49:01.205368 18457 tablet_service.cc:1467] Processing CreateTablet for tablet 360f063b3b544eefa759aeaed0709073 (DEFAULT_TABLE table=test-table [id=14f14c70e21b4cd5955c22f5db3f1084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:01.208106 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.180373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40080 (local address 127.28.92.129:35423)
0809 00:49:01.194136 (+ 13763us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.194145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.194177 (+ 32us) server_negotiation.cc:407] Connection header received
0809 00:49:01.194283 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.194292 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.194556 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.198501 (+ 3945us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:01.198741 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.200300 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.204690 (+ 4390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.206086 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.207324 (+ 1238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.207559 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.207629 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.207789 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13573,"thread_start_us":20551,"threads_started":1}
I20260809 00:49:01.208334 18457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360f063b3b544eefa759aeaed0709073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:01.211917 18024 tablet_service.cc:1467] Processing CreateTablet for tablet 360f063b3b544eefa759aeaed0709073 (DEFAULT_TABLE table=test-table [id=14f14c70e21b4cd5955c22f5db3f1084]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:01.213378 18024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 360f063b3b544eefa759aeaed0709073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:01.238430 18594 tablet_bootstrap.cc:492] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Bootstrap starting.
I20260809 00:49:01.239605 18587 tablet_bootstrap.cc:492] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Bootstrap starting.
I20260809 00:49:01.244755 18594 tablet_bootstrap.cc:654] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:01.247623 18595 tablet_bootstrap.cc:492] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Bootstrap starting.
I20260809 00:49:01.251662 18595 tablet_bootstrap.cc:654] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:01.253216 18587 tablet_bootstrap.cc:654] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:01.254860 18594 log.cc:824] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:01.256242 18587 log.cc:824] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:01.258448 18595 log.cc:824] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:01.272460 18587 tablet_bootstrap.cc:492] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: No bootstrap required, opened a new log
I20260809 00:49:01.276432 18595 tablet_bootstrap.cc:492] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: No bootstrap required, opened a new log
I20260809 00:49:01.276855 18587 ts_tablet_manager.cc:1397] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.000s
I20260809 00:49:01.281134 18595 ts_tablet_manager.cc:1397] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Time spent bootstrapping tablet: real 0.034s user 0.007s sys 0.004s
I20260809 00:49:01.288552 18594 tablet_bootstrap.cc:492] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: No bootstrap required, opened a new log
I20260809 00:49:01.288946 18594 ts_tablet_manager.cc:1397] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Time spent bootstrapping tablet: real 0.051s user 0.004s sys 0.009s
I20260809 00:49:01.311686 18595 raft_consensus.cc:348] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.304729 18587 raft_consensus.cc:348] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.315201 18587 raft_consensus.cc:374] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:01.314484 18594 raft_consensus.cc:348] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.315577 18594 raft_consensus.cc:374] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:01.315738 18587 raft_consensus.cc:729] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c470626bcc1403694e03c02d6fa0c8b, State: Initialized, Role: FOLLOWER
I20260809 00:49:01.316056 18595 raft_consensus.cc:374] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:01.316851 18587 consensus_queue.cc:260] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.317277 18594 raft_consensus.cc:729] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ea60b51df7247b7ade331536f3834f8, State: Initialized, Role: FOLLOWER
I20260809 00:49:01.317480 18595 raft_consensus.cc:729] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50bcb92e50824f45902806f1e87e84a0, State: Initialized, Role: FOLLOWER
I20260809 00:49:01.318554 18594 consensus_queue.cc:260] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.319224 18595 consensus_queue.cc:260] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.329849 18560 heartbeater.cc:503] Master 127.28.92.190:43475 was elected leader, sending a full tablet report...
I20260809 00:49:01.333070 18594 ts_tablet_manager.cc:1428] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Time spent starting tablet: real 0.044s user 0.015s sys 0.001s
I20260809 00:49:01.333772 18595 ts_tablet_manager.cc:1428] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Time spent starting tablet: real 0.052s user 0.013s sys 0.004s
I20260809 00:49:01.335119 18333 heartbeater.cc:503] Master 127.28.92.190:43475 was elected leader, sending a full tablet report...
I20260809 00:49:01.334138 18124 heartbeater.cc:503] Master 127.28.92.190:43475 was elected leader, sending a full tablet report...
I20260809 00:49:01.341248 18587 ts_tablet_manager.cc:1428] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Time spent starting tablet: real 0.064s user 0.016s sys 0.000s
W20260809 00:49:01.345954 18334 tablet.cc:2369] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:49:01.478420 18125 tablet.cc:2369] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:01.489058 18603 raft_consensus.cc:482] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:01.489351 18603 raft_consensus.cc:504] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.491060 18603 leader_election.cc:288] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c470626bcc1403694e03c02d6fa0c8b (127.28.92.130:32801), 7ea60b51df7247b7ade331536f3834f8 (127.28.92.129:35423)
I20260809 00:49:01.496668 18582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.491572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:42901 (local address 127.28.92.130:32801)
0809 00:49:01.491776 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.491782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.491826 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:49:01.491919 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.491923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.492008 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.492101 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:01.492678 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.493387 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.495023 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.495830 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.495979 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.496052 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.496309 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.496432 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 00:49:01.496681 18562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.491475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:32801 (local address 127.28.92.131:42901)
0809 00:49:01.491644 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:01.491660 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:01.491764 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:01.492302 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:01.492310 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:01.492339 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:01.492529 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.492539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.493534 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.493538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.494834 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.494846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.495991 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.495997 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.496154 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.496179 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 00:49:01.496262 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 00:49:01.496393 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 00:49:01.497313 18619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.491908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:35423 (local address 127.28.92.131:44379)
0809 00:49:01.492499 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:01.492513 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:01.492622 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:01.492921 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:01.492925 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:01.492948 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:01.493256 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.493265 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.494266 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.494270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.495569 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:01.495580 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.496672 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.496678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:01.496852 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.496881 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 00:49:01.496967 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 00:49:01.497080 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":309,"threads_started":1}
I20260809 00:49:01.497372 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.492122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:44379 (local address 127.28.92.129:35423)
0809 00:49:01.492321 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.492326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.492595 (+ 269us) server_negotiation.cc:407] Connection header received
0809 00:49:01.492757 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.492760 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.492819 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.492891 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:01.493400 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.494140 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.495710 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.496481 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.496621 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.496689 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.497025 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.497155 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 00:49:01.497877 18266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360f063b3b544eefa759aeaed0709073" candidate_uuid: "50bcb92e50824f45902806f1e87e84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c470626bcc1403694e03c02d6fa0c8b" is_pre_election: true
I20260809 00:49:01.498417 18266 raft_consensus.cc:2454] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50bcb92e50824f45902806f1e87e84a0 in term 0.
I20260809 00:49:01.498394 18054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360f063b3b544eefa759aeaed0709073" candidate_uuid: "50bcb92e50824f45902806f1e87e84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ea60b51df7247b7ade331536f3834f8" is_pre_election: true
W20260809 00:49:01.498663 18561 tablet.cc:2369] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:01.498857 18054 raft_consensus.cc:2454] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50bcb92e50824f45902806f1e87e84a0 in term 0.
I20260809 00:49:01.499178 18370 leader_election.cc:302] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c470626bcc1403694e03c02d6fa0c8b, 50bcb92e50824f45902806f1e87e84a0; no voters:
I20260809 00:49:01.499553 18603 raft_consensus.cc:2781] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:49:01.499708 18603 raft_consensus.cc:482] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:49:01.499819 18603 raft_consensus.cc:3037] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:01.501971 18603 raft_consensus.cc:504] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.502501 18603 leader_election.cc:288] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [CANDIDATE]: Term 1 election: Requested vote from peers 1c470626bcc1403694e03c02d6fa0c8b (127.28.92.130:32801), 7ea60b51df7247b7ade331536f3834f8 (127.28.92.129:35423)
I20260809 00:49:01.502889 18266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360f063b3b544eefa759aeaed0709073" candidate_uuid: "50bcb92e50824f45902806f1e87e84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c470626bcc1403694e03c02d6fa0c8b"
I20260809 00:49:01.502967 18054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "360f063b3b544eefa759aeaed0709073" candidate_uuid: "50bcb92e50824f45902806f1e87e84a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ea60b51df7247b7ade331536f3834f8"
I20260809 00:49:01.503132 18054 raft_consensus.cc:3037] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:01.503118 18266 raft_consensus.cc:3037] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:01.506282 18054 raft_consensus.cc:2454] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50bcb92e50824f45902806f1e87e84a0 in term 1.
I20260809 00:49:01.506383 18266 raft_consensus.cc:2454] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50bcb92e50824f45902806f1e87e84a0 in term 1.
I20260809 00:49:01.506682 18370 leader_election.cc:302] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50bcb92e50824f45902806f1e87e84a0, 7ea60b51df7247b7ade331536f3834f8; no voters:
I20260809 00:49:01.506915 18603 raft_consensus.cc:2781] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:01.507302 18603 raft_consensus.cc:686] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 1 LEADER]: Becoming Leader. State: Replica: 50bcb92e50824f45902806f1e87e84a0, State: Running, Role: LEADER
I20260809 00:49:01.507797 18603 consensus_queue.cc:237] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } }
I20260809 00:49:01.512132 17824 catalog_manager.cc:5495] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 50bcb92e50824f45902806f1e87e84a0 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "50bcb92e50824f45902806f1e87e84a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50bcb92e50824f45902806f1e87e84a0" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 42867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 } health_report { overall_health: UNKNOWN } } }
I20260809 00:49:01.612425 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.606859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45608 (local address 127.28.92.131:42867)
0809 00:49:01.607082 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.607090 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.607316 (+ 226us) server_negotiation.cc:407] Connection header received
0809 00:49:01.607534 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.607538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.607617 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.607747 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:49:01.608141 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.608865 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.610312 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.610713 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.610821 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.611319 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:49:01.611843 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:49:01.611987 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.612085 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.612169 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:49:01.621024 18054 raft_consensus.cc:1261] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 1 FOLLOWER]: Refusing update from remote peer 50bcb92e50824f45902806f1e87e84a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:01.621012 18266 raft_consensus.cc:1261] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 1 FOLLOWER]: Refusing update from remote peer 50bcb92e50824f45902806f1e87e84a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:01.622035 18624 consensus_queue.cc:1035] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c470626bcc1403694e03c02d6fa0c8b" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 32801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:01.622403 18603 consensus_queue.cc:1035] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ea60b51df7247b7ade331536f3834f8" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 35423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:01.636055 18630 mvcc.cc:205] Tried to move back new op lower bound from 7316424874469019648 to 7316424874019606528. Current Snapshot: MvccSnapshot[applied={T|T < 7316424874469019648}]
I20260809 00:49:01.647552 17824 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:01.647809 17824 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:01.651328 17824 catalog_manager.cc:5782] T 00000000000000000000000000000000 P db50fa2a8610452db2aebde83e541f65: Sending DeleteTablet for 3 replicas of tablet 360f063b3b544eefa759aeaed0709073
I20260809 00:49:01.652612 18242 tablet_service.cc:1514] Processing DeleteTablet for tablet 360f063b3b544eefa759aeaed0709073 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:01 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:58128
I20260809 00:49:01.652680 18457 tablet_service.cc:1514] Processing DeleteTablet for tablet 360f063b3b544eefa759aeaed0709073 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:01 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:45592
I20260809 00:49:01.652961 18024 tablet_service.cc:1514] Processing DeleteTablet for tablet 360f063b3b544eefa759aeaed0709073 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:01 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:40080
I20260809 00:49:01.653616 18643 tablet_replica.cc:330] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: stopping tablet replica
I20260809 00:49:01.654119 18643 raft_consensus.cc:2229] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:01.654731 18643 raft_consensus.cc:2258] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:01.655527 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 17876
I20260809 00:49:01.655566 18644 tablet_replica.cc:330] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: stopping tablet replica
I20260809 00:49:01.656056 18644 raft_consensus.cc:2229] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:49:01.656813 18644 raft_consensus.cc:2258] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:01.658227 18643 ts_tablet_manager.cc:1905] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:01.658950 18644 ts_tablet_manager.cc:1905] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:01.666651 18644 ts_tablet_manager.cc:1918] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:01.666975 18644 log.cc:1196] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/360f063b3b544eefa759aeaed0709073
I20260809 00:49:01.667614 18644 ts_tablet_manager.cc:1939] T 360f063b3b544eefa759aeaed0709073 P 50bcb92e50824f45902806f1e87e84a0: Deleting consensus metadata
I20260809 00:49:01.670038 18646 tablet_replica.cc:330] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: stopping tablet replica
I20260809 00:49:01.670503 18646 raft_consensus.cc:2229] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:01.670753 17803 catalog_manager.cc:4841] TS 50bcb92e50824f45902806f1e87e84a0 (127.28.92.131:42867): tablet 360f063b3b544eefa759aeaed0709073 (table test-table [id=14f14c70e21b4cd5955c22f5db3f1084]) successfully deleted
I20260809 00:49:01.671042 18646 raft_consensus.cc:2258] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:01.673319 18643 ts_tablet_manager.cc:1918] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:01.673365 18646 ts_tablet_manager.cc:1905] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:01.673503 18643 log.cc:1196] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/360f063b3b544eefa759aeaed0709073
I20260809 00:49:01.674095 18643 ts_tablet_manager.cc:1939] T 360f063b3b544eefa759aeaed0709073 P 1c470626bcc1403694e03c02d6fa0c8b: Deleting consensus metadata
I20260809 00:49:01.675834 17803 catalog_manager.cc:4841] TS 1c470626bcc1403694e03c02d6fa0c8b (127.28.92.130:32801): tablet 360f063b3b544eefa759aeaed0709073 (table test-table [id=14f14c70e21b4cd5955c22f5db3f1084]) successfully deleted
I20260809 00:49:01.680109 18646 ts_tablet_manager.cc:1918] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:01.680292 18646 log.cc:1196] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/360f063b3b544eefa759aeaed0709073
I20260809 00:49:01.680864 18646 ts_tablet_manager.cc:1939] T 360f063b3b544eefa759aeaed0709073 P 7ea60b51df7247b7ade331536f3834f8: Deleting consensus metadata
I20260809 00:49:01.682672 17803 catalog_manager.cc:4841] TS 7ea60b51df7247b7ade331536f3834f8 (127.28.92.129:35423): tablet 360f063b3b544eefa759aeaed0709073 (table test-table [id=14f14c70e21b4cd5955c22f5db3f1084]) successfully deleted
I20260809 00:49:01.685635 18586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.656359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40096 (local address 127.28.92.129:35423)
0809 00:49:01.656525 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.656531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.667932 (+ 11401us) server_negotiation.cc:407] Connection header received
0809 00:49:01.668437 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.668443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.668569 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.668653 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:01.671509 (+ 2856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.672613 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.674488 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.675145 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.675245 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.679083 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:01.679097 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:01.679115 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:01.679159 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:01.682893 (+ 3734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.683743 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.683751 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.683753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.683904 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.684297 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.684301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.684303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.684652 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:01.684863 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.685179 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.685351 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:49:01.686288 18115 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:01.774209 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 17876
I20260809 00:49:01.796150 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 18128
I20260809 00:49:01.809629 18582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.796912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58140 (local address 127.28.92.130:32801)
0809 00:49:01.797106 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.797112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.797177 (+ 65us) server_negotiation.cc:407] Connection header received
0809 00:49:01.797377 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.797382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.797450 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.797538 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:01.798904 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.799613 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.800872 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.801267 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.801380 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.804031 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:01.804046 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:01.804061 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:01.804093 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:01.806939 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.807589 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.807597 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.807599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.807732 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.808101 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.808105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.808107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.808487 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:01.808773 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.809092 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.809330 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 00:49:01.810427 18326 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:01.899432 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 18128
I20260809 00:49:01.930786 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 18339
I20260809 00:49:01.946625 18584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:01.931629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45620 (local address 127.28.92.131:42867)
0809 00:49:01.931794 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:01.931799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:01.931852 (+ 53us) server_negotiation.cc:407] Connection header received
0809 00:49:01.932054 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:01.932057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:01.932147 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:01.932228 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:01.934123 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.934905 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.936852 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:01.937314 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:01.937415 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:01.940703 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:01.940719 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:01.940739 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:01.940782 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:01.943777 (+ 2995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.944627 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.944635 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.944637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.944783 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:01.945181 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:01.945187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:01.945189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:01.945545 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:01.945827 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:01.946168 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 00:49:01.946330 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 00:49:01.947291 18554 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:02.069023 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 18339
I20260809 00:49:02.092458 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 17777
I20260809 00:49:02.093639 17869 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:02.208827 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 17777
I20260809 00:49:02.237448 29042 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 00:49:02.581838 29042 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 00:49:02.582085 29042 mini_ranger.cc:66] Stopping Ranger...
I20260809 00:49:02.926705 29042 mini_ranger.cc:68] Stopped Ranger
2026-08-09 00:49:02.927 UTC [16327] LOG: received smart shutdown request
2026-08-09 00:49:02.929 UTC [16327] LOG: background worker "logical replication launcher" (PID 16339) exited with exit code 1
2026-08-09 00:49:02.929 UTC [16333] LOG: shutting down
2026-08-09 00:49:03.067 UTC [16327] LOG: database system is shut down
2026-08-09T00:49:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52775 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:49:03 dist-test-slave-t7g5 krb5kdc[18662](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:49:03 dist-test-slave-t7g5 krb5kdc[18662](info): set up 2 sockets
Aug 09 00:49:03 dist-test-slave-t7g5 krb5kdc[18662](info): commencing operation
krb5kdc: starting...
W20260809 00:49:04.412406 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:49:04 dist-test-slave-t7g5 krb5kdc[18662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:49:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:49:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:49:04.670485 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36095
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36095,127.28.92.189:41953,127.28.92.188:34941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:05.004914 18681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:05.005198 18681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:05.005318 18681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:05.012547 18681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:05.012656 18681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:05.012732 18681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:05.012812 18681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:05.012871 18681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:05.022801 18681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36095,127.28.92.189:41953,127.28.92.188:34941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:05.024138 18681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:05.025499 18681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:05.037436 18686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:05.037473 18689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:05.037312 18687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:05.038514 18681 server_base.cc:1034] running on GCE node
I20260809 00:49:05.039294 18681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:05.040659 18681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:05.041844 18681 hybrid_clock.cc:648] HybridClock initialized: now 1786236545041786 us; error 51 us; skew 500 ppm
I20260809 00:49:05.042191 18681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:05 dist-test-slave-t7g5 krb5kdc[18662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:05.050091 18681 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:05.051584 18681 webserver.cc:460] Webserver started at http://127.28.92.190:38405/ using document root <none> and password file <none>
I20260809 00:49:05.052290 18681 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:05.052412 18681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:05.052709 18681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:05.055778 18681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "176c95f1c1ef41aa9ed207a267bf5a3a"
format_stamp: "Formatted at 2026-08-09 00:49:05 on dist-test-slave-t7g5"
server_key: "b712f15befcf4524428f54e6b43fd705"
server_key_iv: "7ffb3289834903594272bbd400089dd0"
server_key_version: "encryptionkey@0"
I20260809 00:49:05.056579 18681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "176c95f1c1ef41aa9ed207a267bf5a3a"
format_stamp: "Formatted at 2026-08-09 00:49:05 on dist-test-slave-t7g5"
server_key: "b712f15befcf4524428f54e6b43fd705"
server_key_iv: "7ffb3289834903594272bbd400089dd0"
server_key_version: "encryptionkey@0"
I20260809 00:49:05.061836 18681 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:49:05.065310 18698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:05.066606 18681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:49:05.066766 18681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "176c95f1c1ef41aa9ed207a267bf5a3a"
format_stamp: "Formatted at 2026-08-09 00:49:05 on dist-test-slave-t7g5"
server_key: "b712f15befcf4524428f54e6b43fd705"
server_key_iv: "7ffb3289834903594272bbd400089dd0"
server_key_version: "encryptionkey@0"
I20260809 00:49:05.066954 18681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:05.081594 18681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:05.085436 18681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:05.085713 18681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:05.103582 18681 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:36095
I20260809 00:49:05.103622 18776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:36095 every 8 connection(s)
I20260809 00:49:05.104934 18681 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:05.108855 18777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:05.113257 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 18681
I20260809 00:49:05.113516 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:49:05.114372 29042 external_mini_cluster.cc:1428] Setting key 9d38db71c5e56f0e68a57ecc9e15fd2f
I20260809 00:49:05.116429 18777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:49:05 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:05.140699 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.120039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47780 (local address 127.28.92.190:36095)
0809 00:49:05.121927 (+ 1888us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:05.121934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:05.121977 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:49:05.123743 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:05.123748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:05.123971 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:05.124125 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:05.125628 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.127307 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.129268 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.129864 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.130000 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.133870 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:05.133878 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:05.133890 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:05.133920 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:05.136559 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.137380 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.137387 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.137389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.137545 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.138008 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.138011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.138013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.138514 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:05.138667 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:05.139303 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 00:49:05.139646 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":1684,"spinlock_wait_cycles":41728,"thread_start_us":1411,"threads_started":1}
I20260809 00:49:05.140738 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.120039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36095 (local address 127.0.0.1:47780)
0809 00:49:05.120976 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.121025 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:05.123392 (+ 2367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:05.124203 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:05.124210 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:05.124945 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:05.125409 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.125437 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.127469 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.127475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.129121 (+ 1646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.129138 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.130121 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.130130 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.130292 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.130947 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:05.130974 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:05.133623 (+ 2649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:05.136692 (+ 3069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.136705 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.136718 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.137262 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.137681 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.137686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.137690 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.137906 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.138663 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:05.138671 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:05.138917 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 00:49:05.139194 (+ 277us) client_negotiation.cc:240] Negotiation successful
0809 00:49:05.139803 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":95,"thread_start_us":406,"threads_started":1}
WARNING: no policy specified for kudu/127.28.92.189@KRBTEST.COM; defaulting to no policy
I20260809 00:49:05.143569 18777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.189@KRBTEST.COM" created.
I20260809 00:49:05.144699 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.144342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44378)
0809 00:49:05.144498 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.144600 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 00:49:05.144972 18705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
I20260809 00:49:05.146485 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.146151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44380)
0809 00:49:05.146290 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.146356 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 00:49:05.146680 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:41953: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab.
Entry for principal kudu/127.28.92.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab.
I20260809 00:49:05.171278 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:41953
--webserver_interface=127.28.92.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab
--principal=kudu/127.28.92.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36095,127.28.92.189:41953,127.28.92.188:34941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:49:05.196069 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } attempt: 1
I20260809 00:49:05.197293 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.196788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44392)
0809 00:49:05.196993 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.197126 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 00:49:05.198405 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.198002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44408)
0809 00:49:05.198149 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.198238 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 00:49:05.198589 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:41953: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
I20260809 00:49:05.266870 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } attempt: 2
I20260809 00:49:05.268227 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.267640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44412)
0809 00:49:05.267923 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.268047 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 00:49:05.269270 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.268851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44428)
0809 00:49:05.269009 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.269113 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 00:49:05.269467 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:41953: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
I20260809 00:49:05.360744 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } attempt: 3
I20260809 00:49:05.362082 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.361484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44444)
0809 00:49:05.361755 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.361901 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 00:49:05.363176 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.362728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44446)
0809 00:49:05.362900 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.362997 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 00:49:05.363430 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:41953: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
W20260809 00:49:05.499451 18789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:05.499720 18789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:05.499816 18789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 00:49:05.506683 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } attempt: 4
W20260809 00:49:05.507108 18789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:05.507203 18789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:05.507284 18789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:05.507356 18789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:05.507419 18789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:05.507893 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.507354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44452)
0809 00:49:05.507662 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.507753 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
I20260809 00:49:05.508868 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.508503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44456)
0809 00:49:05.508652 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.508743 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 00:49:05.509057 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:41953: Network error: Client connection negotiation failed: client connection to 127.28.92.189:41953: connect: Connection refused (error 111)
I20260809 00:49:05.517436 18789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36095,127.28.92.189:41953,127.28.92.188:34941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab
--principal=kudu/127.28.92.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:41953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.92.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:05.518800 18789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:05.520099 18789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:05.531481 18795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:05.531335 18796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:05.531915 18798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:05.532696 18789 server_base.cc:1034] running on GCE node
I20260809 00:49:05.533473 18789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:05.534826 18789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:05.536016 18789 hybrid_clock.cc:648] HybridClock initialized: now 1786236545535957 us; error 55 us; skew 500 ppm
I20260809 00:49:05.536336 18789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:05 dist-test-slave-t7g5 krb5kdc[18662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:05.539347 18789 init.cc:377] Logged in from keytab as kudu/127.28.92.189@KRBTEST.COM (short username kudu)
I20260809 00:49:05.540709 18789 webserver.cc:460] Webserver started at http://127.28.92.189:42985/ using document root <none> and password file <none>
I20260809 00:49:05.541350 18789 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:05.541460 18789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:05.541742 18789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:05.544612 18789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data/instance:
uuid: "d236848b7f6d46be8c22f3923efd21de"
format_stamp: "Formatted at 2026-08-09 00:49:05 on dist-test-slave-t7g5"
server_key: "97e3f463023cde7d1209a02b73eea6cc"
server_key_iv: "38b846bb420856dc5d85a139360260ba"
server_key_version: "encryptionkey@0"
I20260809 00:49:05.545352 18789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal/instance:
uuid: "d236848b7f6d46be8c22f3923efd21de"
format_stamp: "Formatted at 2026-08-09 00:49:05 on dist-test-slave-t7g5"
server_key: "97e3f463023cde7d1209a02b73eea6cc"
server_key_iv: "38b846bb420856dc5d85a139360260ba"
server_key_version: "encryptionkey@0"
I20260809 00:49:05.550303 18789 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 00:49:05.553520 18812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:05.554831 18789 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:49:05.554983 18789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal
uuid: "d236848b7f6d46be8c22f3923efd21de"
format_stamp: "Formatted at 2026-08-09 00:49:05 on dist-test-slave-t7g5"
server_key: "97e3f463023cde7d1209a02b73eea6cc"
server_key_iv: "38b846bb420856dc5d85a139360260ba"
server_key_version: "encryptionkey@0"
I20260809 00:49:05.555158 18789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:05.576517 18789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:05.580569 18789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:05.580823 18789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:05.598325 18789 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.189:41953
I20260809 00:49:05.598403 18896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.189:41953 every 8 connection(s)
I20260809 00:49:05.599614 18789 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
I20260809 00:49:05.603161 18899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:05.604205 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 18789
I20260809 00:49:05.604413 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-1/wal/instance
I20260809 00:49:05.604987 29042 external_mini_cluster.cc:1428] Setting key bdc9de492816f45738238a0159c48ce6
I20260809 00:49:05.611621 18899 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:49:05 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.28.92.188@KRBTEST.COM; defaulting to no policy
I20260809 00:49:05.632819 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.614592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47790 (local address 127.28.92.190:36095)
0809 00:49:05.614775 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:05.614781 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:05.616043 (+ 1262us) server_negotiation.cc:407] Connection header received
0809 00:49:05.617949 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:05.617955 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:05.618039 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:05.618138 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:05.619568 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.620645 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.622275 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.622899 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.623019 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.626442 (+ 3423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:05.626448 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:05.626453 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:05.626494 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:05.629735 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.630481 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.630487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.630491 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.630643 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.631039 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.631045 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.631059 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.631445 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:05.631582 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:05.632348 (+ 766us) server_negotiation.cc:299] Negotiation successful
0809 00:49:05.632585 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:49:05.633765 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.615061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36095 (local address 127.0.0.1:47790)
0809 00:49:05.615865 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.615913 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:05.617640 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:05.618328 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:05.618336 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:05.618850 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:05.619388 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.619405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.620834 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.620839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.622125 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.622139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.623089 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.623094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.623271 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.623892 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:05.623914 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:05.626209 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:05.629884 (+ 3675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.629891 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.629905 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.630342 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.630742 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.630745 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.630747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.630932 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.631569 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:05.631577 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:05.631932 (+ 355us) client_negotiation.cc:769] Sending connection context
0809 00:49:05.632196 (+ 264us) client_negotiation.cc:240] Negotiation successful
0809 00:49:05.632593 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":317,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.188@KRBTEST.COM" created.
I20260809 00:49:05.635542 18899 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:49:05 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:49:05.649343 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.636326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44472)
0809 00:49:05.636494 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.636514 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:05.636626 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:05.637546 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:05.637550 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:05.637991 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:05.638129 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.638137 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.639500 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.639504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.640326 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.640337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.641107 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.641112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.641318 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.641876 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:05.641894 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:05.643795 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:05.646833 (+ 3038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.646838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.646841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.647312 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.647657 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.647662 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.647666 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.647841 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.648401 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:05.648405 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:05.648564 (+ 159us) client_negotiation.cc:769] Sending connection context
0809 00:49:05.648712 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 00:49:05.648989 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 00:49:05.649391 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.636369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44472 (local address 127.28.92.189:41953)
0809 00:49:05.637147 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:05.637152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:05.637177 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:49:05.637219 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:05.637225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:05.637406 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:05.637531 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:05.638281 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.639373 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.640451 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.640973 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.641082 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.643983 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:05.643993 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:05.644006 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:05.644033 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:05.646701 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.647432 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.647438 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.647440 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.647558 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.647944 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.647947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.647949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.648272 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:05.648440 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:05.648833 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 00:49:05.649094 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":628,"thread_start_us":495,"threads_started":1}
I20260809 00:49:05.652100 18899 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:49:05.653254 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.652763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59156)
0809 00:49:05.652931 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.653066 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 00:49:05.653503 18818 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:05.655124 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.654718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59160)
0809 00:49:05.654895 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.654996 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 00:49:05.655359 18899 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab.
Entry for principal kudu/127.28.92.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab.
I20260809 00:49:05.665340 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:34941
--webserver_interface=127.28.92.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab
--principal=kudu/127.28.92.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:40943
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36095,127.28.92.189:41953,127.28.92.188:34941
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:49:05.704668 18899 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 1
I20260809 00:49:05.705915 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.705323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59170)
0809 00:49:05.705560 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.705723 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 00:49:05.706955 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.706572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59184)
0809 00:49:05.706733 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.706820 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 00:49:05.707199 18899 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:05.775436 18899 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 2
I20260809 00:49:05.776648 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.776092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59192)
0809 00:49:05.776321 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.776451 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 00:49:05.777812 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.777383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59200)
0809 00:49:05.777543 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.777634 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260809 00:49:05.778038 18899 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:05.808326 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } attempt: 5
Aug 09 00:49:05 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:49:05.831418 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.809447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44480)
0809 00:49:05.809789 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.809846 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:05.810067 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:05.810667 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:05.810676 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:05.813860 (+ 3184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:05.814142 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.814156 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.815514 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.815520 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.816905 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:05.816922 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.817915 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.817921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:05.818109 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.818770 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:05.818793 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:05.821411 (+ 2618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:05.828831 (+ 7420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.828837 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.828841 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.829333 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.829812 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:05.829817 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:05.829821 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:05.829989 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:05.830659 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:05.830662 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:05.830808 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 00:49:05.830919 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 00:49:05.831154 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95}
I20260809 00:49:05.831682 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.809525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44480 (local address 127.28.92.189:41953)
0809 00:49:05.809754 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:05.809761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:05.809930 (+ 169us) server_negotiation.cc:407] Connection header received
0809 00:49:05.810302 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:05.810308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:05.810405 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:05.810577 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:05.814359 (+ 3782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.815337 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.817069 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:05.817751 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:05.817876 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:05.821629 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:05.821645 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:05.821676 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:05.821723 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:05.828660 (+ 6937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.829468 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.829474 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.829478 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.829647 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:05.830105 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:05.830110 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:05.830113 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:05.830536 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:05.830692 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:05.831069 (+ 377us) server_negotiation.cc:299] Negotiation successful
0809 00:49:05.831332 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:49:05.832756 18777 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:49:05.833861 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.833440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59210)
0809 00:49:05.833605 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.833715 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 00:49:05.834757 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.834462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59216)
0809 00:49:05.834578 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.834662 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 00:49:05.835017 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:05.869304 18899 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 3
I20260809 00:49:05.870729 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.870150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59222)
0809 00:49:05.870410 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.870527 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 00:49:05.872014 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.871516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59232)
0809 00:49:05.871771 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.871869 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260809 00:49:05.872260 18899 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:05.886260 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 1
I20260809 00:49:05.887405 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.886942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59248)
0809 00:49:05.887135 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.887233 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 00:49:05.888445 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.888119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59254)
0809 00:49:05.888262 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.888339 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 00:49:05.888652 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:05.956864 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 2
I20260809 00:49:05.958119 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.957573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59264)
0809 00:49:05.957823 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.957943 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 00:49:05.959147 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:05.958745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59276)
0809 00:49:05.958913 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:05.958987 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260809 00:49:05.959357 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
W20260809 00:49:06.001526 18909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:06.001888 18909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:06.002025 18909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:06.009591 18909 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:06.009740 18909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:06.009825 18909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:06.009907 18909 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:06.009966 18909 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:06.015503 18899 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 4
I20260809 00:49:06.016732 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.016175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59290)
0809 00:49:06.016431 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.016540 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 00:49:06.017807 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.017417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59292)
0809 00:49:06.017555 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.017641 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 00:49:06.018020 18899 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:06.020812 18909 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:40943
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36095,127.28.92.189:41953,127.28.92.188:34941
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab
--principal=kudu/127.28.92.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:34941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.92.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:06.022183 18909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:06.023487 18909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:06.035058 18915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:06.035135 18920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:06.035269 18916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:06.035995 18909 server_base.cc:1034] running on GCE node
I20260809 00:49:06.036767 18909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:06.038223 18909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:06.039443 18909 hybrid_clock.cc:648] HybridClock initialized: now 1786236546039393 us; error 31 us; skew 500 ppm
I20260809 00:49:06.039778 18909 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236546, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:06.042769 18909 init.cc:377] Logged in from keytab as kudu/127.28.92.188@KRBTEST.COM (short username kudu)
I20260809 00:49:06.044170 18909 webserver.cc:460] Webserver started at http://127.28.92.188:37099/ using document root <none> and password file <none>
I20260809 00:49:06.044845 18909 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:06.044963 18909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:06.045249 18909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:06.048254 18909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data/instance:
uuid: "fb7a86ca402d47eb89f89e58a99baba9"
format_stamp: "Formatted at 2026-08-09 00:49:06 on dist-test-slave-t7g5"
server_key: "5c8c980e3b4d4b654f0c5f8e70e0b516"
server_key_iv: "97e0694dc9340c9198904064cab6dd36"
server_key_version: "encryptionkey@0"
I20260809 00:49:06.049067 18909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal/instance:
uuid: "fb7a86ca402d47eb89f89e58a99baba9"
format_stamp: "Formatted at 2026-08-09 00:49:06 on dist-test-slave-t7g5"
server_key: "5c8c980e3b4d4b654f0c5f8e70e0b516"
server_key_iv: "97e0694dc9340c9198904064cab6dd36"
server_key_version: "encryptionkey@0"
I20260809 00:49:06.054155 18909 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:49:06.057461 18931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:06.058858 18909 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:49:06.059031 18909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal
uuid: "fb7a86ca402d47eb89f89e58a99baba9"
format_stamp: "Formatted at 2026-08-09 00:49:06 on dist-test-slave-t7g5"
server_key: "5c8c980e3b4d4b654f0c5f8e70e0b516"
server_key_iv: "97e0694dc9340c9198904064cab6dd36"
server_key_version: "encryptionkey@0"
I20260809 00:49:06.059237 18909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:06.065570 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 3
I20260809 00:49:06.066707 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.066230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59308)
0809 00:49:06.066422 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.066522 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 00:49:06.067698 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.067318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59314)
0809 00:49:06.067476 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.067559 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 00:49:06.067927 18777 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:34941: Network error: Client connection negotiation failed: client connection to 127.28.92.188:34941: connect: Connection refused (error 111)
I20260809 00:49:06.075471 18909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:06.079430 18909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:06.079689 18909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:06.097340 18909 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.188:34941
I20260809 00:49:06.097414 19012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.188:34941 every 8 connection(s)
I20260809 00:49:06.098701 18909 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
I20260809 00:49:06.100895 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 18909
I20260809 00:49:06.101116 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786236336094448-29042-0/minicluster-data/master-2/wal/instance
I20260809 00:49:06.101766 29042 external_mini_cluster.cc:1428] Setting key 76a6b2241167614f652675a45aca9f3c
I20260809 00:49:06.102986 19013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:06.113183 19013 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236546, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:49:06.133793 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.116719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47802 (local address 127.28.92.190:36095)
0809 00:49:06.116879 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.116883 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.117564 (+ 681us) server_negotiation.cc:407] Connection header received
0809 00:49:06.118993 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.119000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.119080 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.119183 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.120533 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.121242 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.123005 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.123635 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.123730 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.127646 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.127651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.127655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.127691 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.130421 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.131307 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.131311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.131313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.131449 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.131887 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.131892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.131904 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.132258 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.132371 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.133176 (+ 805us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.133404 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:49:06.135010 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.116653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:36095 (local address 127.0.0.1:47802)
0809 00:49:06.117429 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.117465 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:06.118682 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:06.119280 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:06.119287 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:06.119961 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:06.120354 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.120373 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.121422 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.121428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.122849 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.122861 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.123860 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.123868 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.124093 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.124946 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:06.124968 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:06.127440 (+ 2472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:06.130543 (+ 3103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.130554 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.130566 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.131199 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.131549 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.131554 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.131557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.131765 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.132368 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:06.132376 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:06.132762 (+ 386us) client_negotiation.cc:769] Sending connection context
0809 00:49:06.133077 (+ 315us) client_negotiation.cc:240] Negotiation successful
0809 00:49:06.133554 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"mutex_wait_us":51,"thread_start_us":390,"threads_started":1}
I20260809 00:49:06.135032 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.103660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.28.92.188:34941)
0809 00:49:06.115597 (+ 11937us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.115612 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.116434 (+ 822us) server_negotiation.cc:407] Connection header received
0809 00:49:06.118658 (+ 2224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.118680 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.118939 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.119099 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.120590 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.121997 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.123509 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.124233 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.124356 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.128496 (+ 4140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.128504 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.128518 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.128547 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.131482 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.132234 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.132240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.132242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.132377 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.132726 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.132731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.132733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.133154 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.133413 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.133797 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.134295 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":11645,"thread_start_us":11870,"threads_started":1}
I20260809 00:49:06.136672 19013 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236546, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:06.150688 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.137495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:41953 (local address 127.0.0.1:44482)
0809 00:49:06.137692 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.137712 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:06.137809 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:06.138102 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:06.138105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:06.138529 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:06.138720 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.138732 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.139719 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.139724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.140705 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.140717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.141416 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.141422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.141635 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.142160 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:06.142182 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:06.144555 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:06.147886 (+ 3331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.147891 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.147906 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.148437 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.148875 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.148880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.148884 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.149074 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.149641 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:06.149647 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:06.149855 (+ 208us) client_negotiation.cc:769] Sending connection context
0809 00:49:06.150036 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 00:49:06.150318 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 00:49:06.150717 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.137539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44482 (local address 127.28.92.189:41953)
0809 00:49:06.137777 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.137782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.137800 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:49:06.137914 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.137917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.137977 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.138080 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.138871 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.139582 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.140839 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.141275 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.141389 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.144766 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.144772 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.144777 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.144811 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.147717 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.148576 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.148581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.148583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.148751 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.149210 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.149214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.149216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.149516 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.149683 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.150156 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.150386 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:49:06.152328 19013 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:49:06.153571 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.138331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47810 (local address 127.28.92.190:36095)
0809 00:49:06.138503 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.138507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.138577 (+ 70us) server_negotiation.cc:407] Connection header received
0809 00:49:06.138730 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.138733 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.138788 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.138873 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.140049 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.140753 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.142271 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.142661 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.142750 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.147184 (+ 4434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.147189 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.147193 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.147226 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.150495 (+ 3269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.151389 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.151404 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.151408 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.151584 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.152003 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.152008 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.152011 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.152422 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.152704 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.153015 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.153250 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236546, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:49:06.166165 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.153107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59318)
0809 00:49:06.153273 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.153291 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:06.153386 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:06.153909 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:06.153912 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:06.154397 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:06.154581 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.154594 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.155702 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.155707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.156628 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.156638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.157311 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.157316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.157504 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.158071 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:06.158092 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:06.160395 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:06.163693 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.163696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.163699 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.164104 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.164468 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.164473 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.164477 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.164640 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.165295 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:06.165298 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:06.165424 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 00:49:06.165545 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 00:49:06.165868 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 00:49:06.166409 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.153157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.28.92.188:34941)
0809 00:49:06.153314 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.153318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.153334 (+ 16us) server_negotiation.cc:407] Connection header received
0809 00:49:06.153506 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.153512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.153586 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.153702 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.154745 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.155553 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.156756 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.157178 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.157298 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.160579 (+ 3281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.160585 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.160590 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.160626 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.163523 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.164222 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.164226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.164228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.164356 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.164780 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.164785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.164787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.165145 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.165307 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.165728 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.166025 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":53}
I20260809 00:49:06.171453 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.155628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44492 (local address 127.28.92.189:41953)
0809 00:49:06.155805 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.155811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.155829 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:49:06.155964 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.155970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.156039 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.156121 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.157353 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.158249 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.159480 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.160097 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.160225 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.165061 (+ 4836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.165068 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.165072 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.165111 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.168759 (+ 3648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.169431 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.169437 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.169440 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.169605 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.170031 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.170037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.170040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.170399 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.170669 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.170901 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.171129 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 00:49:06.172286 19013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: Bootstrap starting.
I20260809 00:49:06.176070 19013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:06.176409 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:49:06.177363 19013 log.cc:824] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:06.180711 19013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: No bootstrap required, opened a new log
I20260809 00:49:06.191329 19013 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.191797 19013 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:06.191916 19013 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb7a86ca402d47eb89f89e58a99baba9, State: Initialized, Role: FOLLOWER
I20260809 00:49:06.192708 19013 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.196913 19035 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.197480 19035 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.198508 19013 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:06.205192 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.181991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44500 (local address 127.28.92.189:41953)
0809 00:49:06.182164 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.182169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.183241 (+ 1072us) server_negotiation.cc:407] Connection header received
0809 00:49:06.183508 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.183513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.183592 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.183660 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.186040 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.187236 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.193415 (+ 6179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.194079 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.194195 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.198091 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.198097 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.198102 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.198144 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.201620 (+ 3476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.202599 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.202606 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.202609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.202791 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.203255 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.203260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.203263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.203652 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.203919 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.204583 (+ 664us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.204828 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:49:06.208478 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.182278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47820 (local address 127.28.92.190:36095)
0809 00:49:06.182465 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.182470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.182826 (+ 356us) server_negotiation.cc:407] Connection header received
0809 00:49:06.183116 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.183122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.183204 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.183282 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.185515 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.186624 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.189702 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.190363 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.190459 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.199805 (+ 9346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.199812 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.199816 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.199875 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.203649 (+ 3774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.204964 (+ 1315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.204970 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.204975 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.205486 (+ 511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.206054 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.206059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.206063 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.206464 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.207717 (+ 1253us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.207849 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.208121 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:49:06.212167 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.183499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.28.92.188:34941)
0809 00:49:06.183668 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.183673 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.194150 (+ 10477us) server_negotiation.cc:407] Connection header received
0809 00:49:06.194215 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.194220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.194295 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.194396 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.197784 (+ 3388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.198838 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.200841 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.201574 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.201708 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.205244 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.205250 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.205255 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.205296 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.209183 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.210017 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.210020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.210023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.210180 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.210556 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.210561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.210565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.211007 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.211274 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.211604 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.211811 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 00:49:06.219065 19054 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:49:06.219189 19054 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:49:06.216735 18909 master_runner.cc:186] Error getting master registration for 127.28.92.190:36095: OK, instance_id { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" instance_seqno: 1786236545098417 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 00:49:06.226884 18909 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 00:49:06.245281 18777 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 4
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:49:06.260316 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.245930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59346 (local address 127.28.92.188:34941)
0809 00:49:06.246121 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.246127 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.246261 (+ 134us) server_negotiation.cc:407] Connection header received
0809 00:49:06.246372 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.246377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.246475 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.246578 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.247298 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.248453 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.249632 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.250330 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.250472 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.253868 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.253874 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.253877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.253910 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.257400 (+ 3490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.258281 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.258284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.258287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.258472 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.258915 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.258919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.258921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.259236 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.259345 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.259853 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.260036 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:49:06.260468 18779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.245944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59346)
0809 00:49:06.246177 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.246192 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:06.246287 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:06.246595 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:06.246599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:06.246988 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:06.247147 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.247155 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.248562 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.248566 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.249490 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.249502 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.250490 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.250495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.250644 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.251266 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:06.251284 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:06.253645 (+ 2361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:06.257552 (+ 3907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.257558 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.257563 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.258159 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.258581 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.258586 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.258590 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.258805 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.259361 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:06.259367 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:06.259585 (+ 218us) client_negotiation.cc:769] Sending connection context
0809 00:49:06.259749 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 00:49:06.260063 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 00:49:06.265805 18777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: Bootstrap starting.
I20260809 00:49:06.268961 18777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:06.270051 18777 log.cc:824] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:06.272826 18777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: No bootstrap required, opened a new log
I20260809 00:49:06.281003 18777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.281327 18777 raft_consensus.cc:374] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:06.281437 18777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176c95f1c1ef41aa9ed207a267bf5a3a, State: Initialized, Role: FOLLOWER
I20260809 00:49:06.282063 18777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.282996 19058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.283412 19058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.284225 18777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: configured and running, proceeding with master startup.
W20260809 00:49:06.294330 19072 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:49:06.294484 19072 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:49:06.296103 18681 master_runner.cc:186] Error getting master registration for 127.28.92.189:41953: OK, instance_id { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" instance_seqno: 1786236545593304 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 00:49:06.306886 18681 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 00:49:06.317251 18899 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } attempt: 5
Aug 09 00:49:06 dist-test-slave-t7g5 krb5kdc[18662](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236545, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
W20260809 00:49:06.331781 18939 tablet.cc:2369] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:06.335784 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.318004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:34941 (local address 127.0.0.1:59360)
0809 00:49:06.318338 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:06.318359 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:06.318492 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:06.318865 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:06.318871 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:06.319432 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:06.319651 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.319665 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.321200 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.321206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.322693 (+ 1487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:06.322711 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.323968 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.323975 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:06.324245 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.325512 (+ 1267us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:06.325537 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:06.328436 (+ 2899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:06.332794 (+ 4358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.332801 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.332805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.333399 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.333833 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:06.333838 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:06.333842 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:06.334016 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:06.334680 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:06.334685 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:06.334861 (+ 176us) client_negotiation.cc:769] Sending connection context
0809 00:49:06.335030 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 00:49:06.335353 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260809 00:49:06.335834 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:06.318099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59360 (local address 127.28.92.188:34941)
0809 00:49:06.318342 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:06.318348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:06.318423 (+ 75us) server_negotiation.cc:407] Connection header received
0809 00:49:06.318624 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:06.318630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:06.318713 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:06.318820 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:06.319832 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.321038 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.322849 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:06.323615 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:06.323746 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:06.328651 (+ 4905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:06.328658 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:06.328663 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:06.328720 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:06.332659 (+ 3939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.333531 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.333537 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.333541 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.333714 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:06.334131 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:06.334136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:06.334140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:06.334539 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:06.334689 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:06.335158 (+ 469us) server_negotiation.cc:299] Negotiation successful
0809 00:49:06.335426 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
W20260809 00:49:06.338384 18707 tablet.cc:2369] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:06.343890 18899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: Bootstrap starting.
I20260809 00:49:06.348097 18899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:06.349418 18899 log.cc:824] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:06.352751 18899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: No bootstrap required, opened a new log
I20260809 00:49:06.363951 18899 raft_consensus.cc:348] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.364382 18899 raft_consensus.cc:374] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:06.364513 18899 raft_consensus.cc:729] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d236848b7f6d46be8c22f3923efd21de, State: Initialized, Role: FOLLOWER
I20260809 00:49:06.365163 18899 consensus_queue.cc:260] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.366215 19076 sys_catalog.cc:455] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.366719 19076 sys_catalog.cc:458] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.367527 18899 sys_catalog.cc:564] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:06.403177 18789 master_runner.cc:263] No leader master found from master d236848b7f6d46be8c22f3923efd21de
I20260809 00:49:06.403352 18789 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 00:49:06.408481 19095 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:49:06.408649 19095 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:49:06.539937 19058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:06.540338 19058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.542419 19058 leader_election.cc:288] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d236848b7f6d46be8c22f3923efd21de (127.28.92.189:41953), fb7a86ca402d47eb89f89e58a99baba9 (127.28.92.188:34941)
I20260809 00:49:06.544061 18976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a86ca402d47eb89f89e58a99baba9" is_pre_election: true
I20260809 00:49:06.544783 18976 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 176c95f1c1ef41aa9ed207a267bf5a3a in term 0.
I20260809 00:49:06.546033 18851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d236848b7f6d46be8c22f3923efd21de" is_pre_election: true
I20260809 00:49:06.546707 18851 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 176c95f1c1ef41aa9ed207a267bf5a3a in term 0.
I20260809 00:49:06.547554 18705 leader_election.cc:302] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176c95f1c1ef41aa9ed207a267bf5a3a, fb7a86ca402d47eb89f89e58a99baba9; no voters:
I20260809 00:49:06.548168 19058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:49:06.548341 19058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:49:06.548470 19058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:06.552857 19058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.560740 18851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d236848b7f6d46be8c22f3923efd21de"
I20260809 00:49:06.561028 18851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:06.565263 18851 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 176c95f1c1ef41aa9ed207a267bf5a3a in term 1.
I20260809 00:49:06.565874 18705 leader_election.cc:302] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176c95f1c1ef41aa9ed207a267bf5a3a, d236848b7f6d46be8c22f3923efd21de; no voters:
I20260809 00:49:06.570053 19058 leader_election.cc:288] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [CANDIDATE]: Term 1 election: Requested vote from peers d236848b7f6d46be8c22f3923efd21de (127.28.92.189:41953), fb7a86ca402d47eb89f89e58a99baba9 (127.28.92.188:34941)
I20260809 00:49:06.570779 19058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:06.571290 19058 raft_consensus.cc:686] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [term 1 LEADER]: Becoming Leader. State: Replica: 176c95f1c1ef41aa9ed207a267bf5a3a, State: Running, Role: LEADER
I20260809 00:49:06.572243 19058 consensus_queue.cc:237] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } }
I20260809 00:49:06.581818 18976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb7a86ca402d47eb89f89e58a99baba9"
I20260809 00:49:06.582088 18976 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 0 FOLLOWER]: Advancing to term 1
W20260809 00:49:06.584391 18820 tablet.cc:2369] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:06.587651 18976 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 176c95f1c1ef41aa9ed207a267bf5a3a in term 1.
I20260809 00:49:06.594620 19097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176c95f1c1ef41aa9ed207a267bf5a3a. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.595144 19097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:06.602454 19099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:06.604823 19099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:06.621899 18976 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [term 1 FOLLOWER]: Refusing update from remote peer 176c95f1c1ef41aa9ed207a267bf5a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:06.626441 19097 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:06.634613 18851 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [term 1 FOLLOWER]: Refusing update from remote peer 176c95f1c1ef41aa9ed207a267bf5a3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:06.636001 19097 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:06.671490 19076 sys_catalog.cc:455] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176c95f1c1ef41aa9ed207a267bf5a3a. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.671829 19076 sys_catalog.cc:458] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.675895 19100 mvcc.cc:205] Tried to move back new op lower bound from 7316424894947151872 to 7316424894772289536. Current Snapshot: MvccSnapshot[applied={T|T < 7316424894947151872}]
I20260809 00:49:06.684755 19035 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176c95f1c1ef41aa9ed207a267bf5a3a. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.685118 19035 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.686653 19099 catalog_manager.cc:1347] Generated new cluster ID: fa2be8a1bad844048110553941e90c04
I20260809 00:49:06.686779 19099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:49:06.690039 19076 sys_catalog.cc:455] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.690315 19076 sys_catalog.cc:458] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.690192 19058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.690485 19058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:06.693821 19097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.694172 19097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:06.704977 19102 mvcc.cc:205] Tried to move back new op lower bound from 7316424894947151872 to 7316424894772289536. Current Snapshot: MvccSnapshot[applied={T|T < 7316424894947151872}]
I20260809 00:49:06.709329 19035 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "176c95f1c1ef41aa9ed207a267bf5a3a" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36095 } } peers { permanent_uuid: "d236848b7f6d46be8c22f3923efd21de" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 41953 } } peers { permanent_uuid: "fb7a86ca402d47eb89f89e58a99baba9" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 34941 } } }
I20260809 00:49:06.709636 19035 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:49:06.712296 19099 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:49:06.715265 19099 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:49:06.726982 19099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 176c95f1c1ef41aa9ed207a267bf5a3a: Generated new TSK 0
I20260809 00:49:06.728483 19099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:49:07.221328 19054 catalog_manager.cc:1259] Loaded cluster ID: fa2be8a1bad844048110553941e90c04
I20260809 00:49:07.221451 19054 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: loading cluster ID for follower catalog manager: success
I20260809 00:49:07.224112 19054 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: acquiring CA information for follower catalog manager: success
I20260809 00:49:07.226171 19054 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fb7a86ca402d47eb89f89e58a99baba9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 00:49:07.410884 19095 catalog_manager.cc:1259] Loaded cluster ID: fa2be8a1bad844048110553941e90c04
I20260809 00:49:07.411000 19095 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: loading cluster ID for follower catalog manager: success
I20260809 00:49:07.413503 19095 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: acquiring CA information for follower catalog manager: success
I20260809 00:49:07.415387 19095 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d236848b7f6d46be8c22f3923efd21de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 00:49:07.829978 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 18681
I20260809 00:49:07.832228 18770 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:07.950541 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 18681
I20260809 00:49:07.981791 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 18789
I20260809 00:49:07.983026 18890 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:08.090337 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 18789
I20260809 00:49:08.120437 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 18909
I20260809 00:49:08.121721 19006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:08.238318 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 18909
2026-08-09T00:49:08Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5074 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:49:08 dist-test-slave-t7g5 krb5kdc[19128](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:49:08 dist-test-slave-t7g5 krb5kdc[19128](info): set up 2 sockets
Aug 09 00:49:08 dist-test-slave-t7g5 krb5kdc[19128](info): commencing operation
krb5kdc: starting...
W20260809 00:49:09.481102 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:49:09 dist-test-slave-t7g5 krb5kdc[19128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:49:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:49:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:49:09.753276 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:40835
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:40835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:10.105571 19145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:10.106053 19145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:10.106204 19145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:10.113691 19145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:10.113819 19145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:10.113909 19145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:10.113981 19145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:10.114046 19145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:10.124265 19145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:40835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:40835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:10.125697 19145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:10.127069 19145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:10.139247 19152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:10.139349 19153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:10.139293 19155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:10.140385 19145 server_base.cc:1034] running on GCE node
I20260809 00:49:10.141299 19145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:10.142892 19145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:10.144122 19145 hybrid_clock.cc:648] HybridClock initialized: now 1786236550144072 us; error 37 us; skew 500 ppm
I20260809 00:49:10.144510 19145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:10 dist-test-slave-t7g5 krb5kdc[19128](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236550, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:10.150329 19145 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:10.151875 19145 webserver.cc:460] Webserver started at http://127.28.92.190:35487/ using document root <none> and password file <none>
I20260809 00:49:10.152552 19145 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:10.152670 19145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:10.152979 19145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:10.156116 19145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "f3cb003dce044497a3b9c2764123a421"
format_stamp: "Formatted at 2026-08-09 00:49:10 on dist-test-slave-t7g5"
server_key: "c0f92fb889ac0486e5e834bca6f687da"
server_key_iv: "157018ba572184c5c39d8799d041d627"
server_key_version: "encryptionkey@0"
I20260809 00:49:10.156894 19145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "f3cb003dce044497a3b9c2764123a421"
format_stamp: "Formatted at 2026-08-09 00:49:10 on dist-test-slave-t7g5"
server_key: "c0f92fb889ac0486e5e834bca6f687da"
server_key_iv: "157018ba572184c5c39d8799d041d627"
server_key_version: "encryptionkey@0"
I20260809 00:49:10.164049 19145 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20260809 00:49:10.167683 19163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:10.169107 19145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:49:10.169304 19145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "f3cb003dce044497a3b9c2764123a421"
format_stamp: "Formatted at 2026-08-09 00:49:10 on dist-test-slave-t7g5"
server_key: "c0f92fb889ac0486e5e834bca6f687da"
server_key_iv: "157018ba572184c5c39d8799d041d627"
server_key_version: "encryptionkey@0"
I20260809 00:49:10.169512 19145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:10.190414 19145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:10.195952 19145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:10.196202 19145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:10.213781 19145 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:40835
I20260809 00:49:10.213807 19249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:40835 every 8 connection(s)
I20260809 00:49:10.215376 19145 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:10.219426 19251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:10.222178 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 19145
I20260809 00:49:10.222425 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:49:10.223318 29042 external_mini_cluster.cc:1428] Setting key ead30592a3862eaccfc21e968cdcadf0
I20260809 00:49:10.232106 19251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421: Bootstrap starting.
I20260809 00:49:10.235390 19251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:10.236495 19251 log.cc:824] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421: Log is configured to *not* fsync() on all Append() calls
Aug 09 00:49:10 dist-test-slave-t7g5 krb5kdc[19128](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:10.239887 19251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421: No bootstrap required, opened a new log
I20260809 00:49:10.248550 19254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:10.225531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43032 (local address 127.28.92.190:40835)
0809 00:49:10.226632 (+ 1101us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:10.226644 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:10.226691 (+ 47us) server_negotiation.cc:407] Connection header received
0809 00:49:10.228647 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:10.228674 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:10.229118 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:10.229524 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:10.231156 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:10.232545 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:10.233919 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:10.234592 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:10.234759 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:10.239488 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:10.239502 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:10.239523 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:10.239576 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:10.243666 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:10.244439 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:10.244447 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:10.244456 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:10.244698 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:10.245055 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:10.245060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:10.245063 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:10.245888 (+ 825us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:10.246215 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:10.246625 (+ 410us) server_negotiation.cc:299] Negotiation successful
0809 00:49:10.247108 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":863,"thread_start_us":458,"threads_started":1}
I20260809 00:49:10.250739 19251 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3cb003dce044497a3b9c2764123a421" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40835 } }
I20260809 00:49:10.251107 19251 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:10.251250 19251 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cb003dce044497a3b9c2764123a421, State: Initialized, Role: FOLLOWER
I20260809 00:49:10.251930 19251 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3cb003dce044497a3b9c2764123a421" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40835 } }
I20260809 00:49:10.252655 19251 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:49:10.252835 19251 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:49:10.253005 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:49:10.253058 19251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:10.256448 19251 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3cb003dce044497a3b9c2764123a421" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40835 } }
I20260809 00:49:10.257215 19251 leader_election.cc:302] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3cb003dce044497a3b9c2764123a421; no voters:
I20260809 00:49:10.258019 19251 leader_election.cc:288] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:49:10.258262 19257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:10.259181 19257 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [term 1 LEADER]: Becoming Leader. State: Replica: f3cb003dce044497a3b9c2764123a421, State: Running, Role: LEADER
I20260809 00:49:10.260080 19257 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3cb003dce044497a3b9c2764123a421" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40835 } }
I20260809 00:49:10.261458 19251 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:10.263765 19258 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3cb003dce044497a3b9c2764123a421. Latest consensus state: current_term: 1 leader_uuid: "f3cb003dce044497a3b9c2764123a421" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3cb003dce044497a3b9c2764123a421" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40835 } } }
I20260809 00:49:10.264678 19258 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:10.264467 19259 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3cb003dce044497a3b9c2764123a421" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3cb003dce044497a3b9c2764123a421" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 40835 } } }
I20260809 00:49:10.264909 19259 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:10.267742 19270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:10.272574 19270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:10.283456 19270 catalog_manager.cc:1347] Generated new cluster ID: f8436a1b30044c42971635b9a58f435e
I20260809 00:49:10.283638 19270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:49:10.302269 19270 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:49:10.304399 19270 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:49:10.318905 19270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3cb003dce044497a3b9c2764123a421: Generated new TSK 0
I20260809 00:49:10.319866 19270 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:49:10.368839 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 19145
I20260809 00:49:10.370270 19243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:10.470121 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 19145
2026-08-09T00:49:10Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2229 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:49:10 dist-test-slave-t7g5 krb5kdc[19289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:49:10 dist-test-slave-t7g5 krb5kdc[19289](info): set up 2 sockets
Aug 09 00:49:10 dist-test-slave-t7g5 krb5kdc[19289](info): commencing operation
krb5kdc: starting...
W20260809 00:49:11.705370 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:49:11 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:49:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:49:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:49:11.958911 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41567
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:41567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:12.288902 19309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:12.289202 19309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:12.289335 19309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:12.296705 19309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:12.296816 19309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:12.296875 19309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:12.296955 19309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:12.297030 19309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:12.307339 19309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:41567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:12.308634 19309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:12.309963 19309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:12.321404 19315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:12.321520 19316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:12.321712 19318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:12.322332 19309 server_base.cc:1034] running on GCE node
I20260809 00:49:12.323130 19309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:12.324462 19309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:12.325685 19309 hybrid_clock.cc:648] HybridClock initialized: now 1786236552325613 us; error 39 us; skew 500 ppm
I20260809 00:49:12.326043 19309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:12 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:12.329272 19309 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:12.330718 19309 webserver.cc:460] Webserver started at http://127.28.92.190:42579/ using document root <none> and password file <none>
I20260809 00:49:12.331367 19309 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:12.331489 19309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:12.331773 19309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:12.334741 19309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "0b45b374ed744bcba937b70913a7ce05"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "457381c87e94a9fddcf9334c4ad20409"
server_key_iv: "94df42f49d86acdacdf6677c7424583d"
server_key_version: "encryptionkey@0"
I20260809 00:49:12.335489 19309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "0b45b374ed744bcba937b70913a7ce05"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "457381c87e94a9fddcf9334c4ad20409"
server_key_iv: "94df42f49d86acdacdf6677c7424583d"
server_key_version: "encryptionkey@0"
I20260809 00:49:12.340451 19309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 00:49:12.343852 19332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:12.345103 19309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:49:12.345258 19309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "0b45b374ed744bcba937b70913a7ce05"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "457381c87e94a9fddcf9334c4ad20409"
server_key_iv: "94df42f49d86acdacdf6677c7424583d"
server_key_version: "encryptionkey@0"
I20260809 00:49:12.345434 19309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:12.368062 19309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:12.372099 19309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:12.372370 19309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:12.390616 19309 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:41567
I20260809 00:49:12.390656 19413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:41567 every 8 connection(s)
I20260809 00:49:12.391935 19309 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:12.395823 19414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:12.399466 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 19309
I20260809 00:49:12.399665 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:49:12.400302 29042 external_mini_cluster.cc:1428] Setting key 6f59abe254be83d7f6d3196660f82e23
I20260809 00:49:12.406880 19414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap starting.
I20260809 00:49:12.410413 19414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:12.411603 19414 log.cc:824] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:12.414299 19414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: No bootstrap required, opened a new log
Aug 09 00:49:12 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:12.422446 19414 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:12.422788 19414 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:12.422904 19414 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45b374ed744bcba937b70913a7ce05, State: Initialized, Role: FOLLOWER
I20260809 00:49:12.423313 19422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:12.402261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46566 (local address 127.28.92.190:41567)
0809 00:49:12.403120 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:12.403132 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:12.403170 (+ 38us) server_negotiation.cc:407] Connection header received
0809 00:49:12.405327 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:12.405351 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:12.405757 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:12.406068 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:12.407919 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:12.409233 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:12.411085 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:12.411791 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:12.411942 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:12.416092 (+ 4150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:12.416106 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:12.416124 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:12.416166 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:12.419357 (+ 3191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:12.420031 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:12.420038 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:12.420044 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:12.420222 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:12.420602 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:12.420606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:12.420608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:12.421123 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:12.421456 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:12.421918 (+ 462us) server_negotiation.cc:299] Negotiation successful
0809 00:49:12.422314 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":362,"threads_started":1}
I20260809 00:49:12.423519 19414 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:12.423758 19414 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:49:12.423906 19414 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:49:12.424065 19414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:12.426980 19414 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:12.427425 19414 leader_election.cc:302] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b45b374ed744bcba937b70913a7ce05; no voters:
I20260809 00:49:12.427978 19414 leader_election.cc:288] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:49:12.428120 19425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:12.428820 19425 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 LEADER]: Becoming Leader. State: Replica: 0b45b374ed744bcba937b70913a7ce05, State: Running, Role: LEADER
I20260809 00:49:12.429394 19425 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:12.429837 19414 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:12.432353 19427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b45b374ed744bcba937b70913a7ce05. Latest consensus state: current_term: 1 leader_uuid: "0b45b374ed744bcba937b70913a7ce05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } } }
I20260809 00:49:12.432698 19427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:12.433357 19426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b45b374ed744bcba937b70913a7ce05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } } }
I20260809 00:49:12.433746 19426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:12.436990 19437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:12.441777 19437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:12.450249 19437 catalog_manager.cc:1347] Generated new cluster ID: 48526bd574534ec191135816d344422d
I20260809 00:49:12.450394 19437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:49:12.479701 19437 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:49:12.481151 19437 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:49:12.491119 19437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Generated new TSK 0
I20260809 00:49:12.491961 19437 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:49:12.565296 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41567
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:12.899029 19454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:12.899302 19454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:12.899451 19454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:12.907929 19454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:12.908046 19454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:12.908208 19454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:49:12.918466 19454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:12.919790 19454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:12.921074 19454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:12.933579 19461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:12.933614 19463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:12.934237 19465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:12.934478 19454 server_base.cc:1034] running on GCE node
I20260809 00:49:12.935029 19454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:12.935889 19454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:12.937091 19454 hybrid_clock.cc:648] HybridClock initialized: now 1786236552937036 us; error 45 us; skew 500 ppm
I20260809 00:49:12.937417 19454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:12 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:12.940552 19454 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:49:12.941906 19454 webserver.cc:460] Webserver started at http://127.28.92.129:41265/ using document root <none> and password file <none>
I20260809 00:49:12.942539 19454 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:12.942651 19454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:12.942945 19454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:12.945708 19454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "557402c23feb4dca911bc3ed97393cdc"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "794e7c4bd6653030cbcaf5a3a1281fcf"
server_key_iv: "ad966330d806e5f10f7aeef5ac1c6e0f"
server_key_version: "encryptionkey@0"
I20260809 00:49:12.946455 19454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "557402c23feb4dca911bc3ed97393cdc"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "794e7c4bd6653030cbcaf5a3a1281fcf"
server_key_iv: "ad966330d806e5f10f7aeef5ac1c6e0f"
server_key_version: "encryptionkey@0"
I20260809 00:49:12.951354 19454 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:49:12.954548 19475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:12.955765 19454 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:49:12.955924 19454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "557402c23feb4dca911bc3ed97393cdc"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "794e7c4bd6653030cbcaf5a3a1281fcf"
server_key_iv: "ad966330d806e5f10f7aeef5ac1c6e0f"
server_key_version: "encryptionkey@0"
I20260809 00:49:12.956094 19454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:12.969708 19454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:12.973536 19454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:12.973817 19454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:12.974647 19454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:12.975888 19454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:12.975960 19454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:12.976048 19454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:12.976094 19454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:13.003983 19454 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:33621
I20260809 00:49:13.004031 19646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:33621 every 8 connection(s)
I20260809 00:49:13.005206 19454 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:49:13.011317 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 19454
I20260809 00:49:13.011523 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:49:13.012195 29042 external_mini_cluster.cc:1428] Setting key 53645661fc4f1a1ae1e0df898b0235e5
Aug 09 00:49:13 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236552, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:13.024839 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:13.007663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:42351 (local address 127.28.92.190:41567)
0809 00:49:13.008112 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:13.008116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:13.009010 (+ 894us) server_negotiation.cc:407] Connection header received
0809 00:49:13.010853 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:13.010858 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:13.010938 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:13.011035 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:13.012566 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.013420 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.015104 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.015515 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.015631 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:13.018953 (+ 3322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:13.018958 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:13.018961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:13.018994 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:13.022046 (+ 3052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:13.022737 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:13.022742 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:13.022745 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:13.022897 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:13.023276 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:13.023280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:13.023283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:13.023611 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:13.023759 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:13.024389 (+ 630us) server_negotiation.cc:299] Negotiation successful
0809 00:49:13.024575 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":239,"threads_started":1}
I20260809 00:49:13.026191 19651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:13.008108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:42351)
0809 00:49:13.008865 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:13.008903 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:13.010585 (+ 1682us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:13.011269 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:13.011277 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:13.011826 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:13.012400 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:13.012420 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.013574 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.013577 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:13.014955 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:13.014968 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.015736 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.015744 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:13.015971 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:13.016582 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:13.016604 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:13.018742 (+ 2138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:13.022180 (+ 3438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:13.022187 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:13.022201 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:13.022614 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:13.022982 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:13.022985 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:13.022987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:13.023172 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:13.023710 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:13.023715 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:13.024008 (+ 293us) client_negotiation.cc:769] Sending connection context
0809 00:49:13.024214 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 00:49:13.024714 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":288,"threads_started":1}
I20260809 00:49:13.027676 19647 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41567
I20260809 00:49:13.028040 19647 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:13.028872 19647 heartbeater.cc:511] Master 127.28.92.190:41567 requested a full tablet report, sending...
I20260809 00:49:13.031059 19357 ts_manager.cc:194] Registered new tserver with Master: 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621)
I20260809 00:49:13.032526 19357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:42351
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:49:13.070176 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41567
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:13.395514 19655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:13.395804 19655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:13.395958 19655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:13.403169 19655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:13.403303 19655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:13.403471 19655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:49:13.413349 19655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:13.414673 19655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:13.416128 19655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:13.429176 19662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:13.429136 19661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:13.429211 19664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:13.429993 19655 server_base.cc:1034] running on GCE node
I20260809 00:49:13.430644 19655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:13.431665 19655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:13.432891 19655 hybrid_clock.cc:648] HybridClock initialized: now 1786236553432841 us; error 61 us; skew 500 ppm
I20260809 00:49:13.433215 19655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:13 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236553, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:13.436537 19655 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:49:13.438170 19655 webserver.cc:460] Webserver started at http://127.28.92.130:34067/ using document root <none> and password file <none>
I20260809 00:49:13.438879 19655 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:13.439015 19655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:13.439337 19655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:13.442462 19655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "a755cf7931dd45d6ac698c1b16d69752"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "d7e28cd2a614c6093437cdfe845c8925"
server_key_iv: "84ef9f895ff7649fc1308808089101f8"
server_key_version: "encryptionkey@0"
I20260809 00:49:13.443295 19655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "a755cf7931dd45d6ac698c1b16d69752"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "d7e28cd2a614c6093437cdfe845c8925"
server_key_iv: "84ef9f895ff7649fc1308808089101f8"
server_key_version: "encryptionkey@0"
I20260809 00:49:13.448676 19655 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:49:13.452453 19671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:13.453810 19655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 00:49:13.454046 19655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "a755cf7931dd45d6ac698c1b16d69752"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "d7e28cd2a614c6093437cdfe845c8925"
server_key_iv: "84ef9f895ff7649fc1308808089101f8"
server_key_version: "encryptionkey@0"
I20260809 00:49:13.454274 19655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:13.466810 19655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:13.470996 19655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:13.471283 19655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:13.472239 19655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:13.473613 19655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:13.473716 19655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:13.473855 19655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:13.473913 19655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:13.506289 19655 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:35921
I20260809 00:49:13.506315 19847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:35921 every 8 connection(s)
I20260809 00:49:13.507632 19655 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:49:13.513325 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 19655
I20260809 00:49:13.513542 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:49:13.514158 29042 external_mini_cluster.cc:1428] Setting key fdc8a6f88c3eec231e1de7d4ae76a30f
Aug 09 00:49:13 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236553, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:13.528981 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:13.510316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:37693 (local address 127.28.92.190:41567)
0809 00:49:13.510514 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:13.510519 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:13.511621 (+ 1102us) server_negotiation.cc:407] Connection header received
0809 00:49:13.513584 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:13.513590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:13.513715 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:13.513818 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:13.515653 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.516546 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.518728 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.519186 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.519293 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:13.523310 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:13.523315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:13.523318 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:13.523350 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:13.525825 (+ 2475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:13.526642 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:13.526647 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:13.526650 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:13.526852 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:13.527301 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:13.527304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:13.527306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:13.527610 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:13.527774 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:13.528410 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 00:49:13.528648 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:49:13.529985 19851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:13.510736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:37693)
0809 00:49:13.511452 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:13.511505 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:13.513263 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:13.514080 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:13.514091 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:13.514812 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:13.515453 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:13.515500 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.516712 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.516718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:13.518583 (+ 1865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:13.518599 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:13.519407 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:13.519414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:13.519715 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:13.520408 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:13.520459 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:13.523085 (+ 2626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:13.525954 (+ 2869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:13.525963 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:13.525979 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:13.526516 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:13.526965 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:13.526970 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:13.526973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:13.527208 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:13.527739 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:13.527746 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:13.528055 (+ 309us) client_negotiation.cc:769] Sending connection context
0809 00:49:13.528280 (+ 225us) client_negotiation.cc:240] Negotiation successful
0809 00:49:13.528717 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":261,"threads_started":1}
I20260809 00:49:13.531458 19848 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41567
I20260809 00:49:13.531766 19848 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:13.532514 19848 heartbeater.cc:511] Master 127.28.92.190:41567 requested a full tablet report, sending...
I20260809 00:49:13.534121 19357 ts_manager.cc:194] Registered new tserver with Master: a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
I20260809 00:49:13.535005 19357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:37693
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:49:13.570979 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41567
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:13.902302 19856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:13.902606 19856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:13.902755 19856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:13.910784 19856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:13.910907 19856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:13.911063 19856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:49:13.920899 19856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:13.922231 19856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:13.923538 19856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:13.936097 19863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:13.936120 19864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:13.936672 19867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:13.937040 19856 server_base.cc:1034] running on GCE node
I20260809 00:49:13.937626 19856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:13.938611 19856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:13.939816 19856 hybrid_clock.cc:648] HybridClock initialized: now 1786236553939775 us; error 47 us; skew 500 ppm
I20260809 00:49:13.940109 19856 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:13 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236553, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:13.946127 19856 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:49:13.947582 19856 webserver.cc:460] Webserver started at http://127.28.92.131:43331/ using document root <none> and password file <none>
I20260809 00:49:13.948247 19856 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:13.948370 19856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:13.948662 19856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:13.951520 19856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "4163ca7627424e96b00508df94acfd9e"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "72052885ee78d93e5b00d440a88ed001"
server_key_iv: "8529096b9a03e2327b2e466f3cab5e3d"
server_key_version: "encryptionkey@0"
I20260809 00:49:13.952278 19856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "4163ca7627424e96b00508df94acfd9e"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "72052885ee78d93e5b00d440a88ed001"
server_key_iv: "8529096b9a03e2327b2e466f3cab5e3d"
server_key_version: "encryptionkey@0"
I20260809 00:49:13.957224 19856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:49:13.960557 19876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:13.961886 19856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 00:49:13.962036 19856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "4163ca7627424e96b00508df94acfd9e"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "72052885ee78d93e5b00d440a88ed001"
server_key_iv: "8529096b9a03e2327b2e466f3cab5e3d"
server_key_version: "encryptionkey@0"
I20260809 00:49:13.962211 19856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:13.986370 19856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:13.990091 19856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:13.990356 19856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:13.991251 19856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:13.992507 19856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:13.992586 19856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:13.992703 19856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:13.992758 19856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:14.023705 19856 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41179
I20260809 00:49:14.023739 20054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41179 every 8 connection(s)
I20260809 00:49:14.024958 19856 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:49:14.034127 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 19856
I20260809 00:49:14.034299 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:49:14.034735 29042 external_mini_cluster.cc:1428] Setting key 582f02afc452f314712afe6a82a4fa2b
I20260809 00:49:14.035913 19647 heartbeater.cc:503] Master 127.28.92.190:41567 was elected leader, sending a full tablet report...
Aug 09 00:49:14 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236553, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:14.044281 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.027504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:40145 (local address 127.28.92.190:41567)
0809 00:49:14.027688 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.027693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.028771 (+ 1078us) server_negotiation.cc:407] Connection header received
0809 00:49:14.030821 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.030827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.030916 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.031033 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:14.032452 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.033290 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.035027 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.035498 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.035622 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.039453 (+ 3831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:14.039458 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:14.039462 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:14.039492 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:14.041874 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.042500 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.042503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.042506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.042626 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.042960 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.042963 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.042965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.043221 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:14.043326 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.043888 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.044040 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:49:14.045151 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.027915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:40145)
0809 00:49:14.028619 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.028656 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:14.030522 (+ 1866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:14.031254 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:14.031262 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:14.031751 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:14.032278 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.032295 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.033448 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.033452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.034893 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.034905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.035747 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.035756 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.036057 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.036775 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:14.036798 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:14.039257 (+ 2459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:14.041984 (+ 2727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:14.041990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:14.042001 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:14.042412 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:14.042699 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:14.042702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:14.042704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:14.042880 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:14.043311 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:14.043316 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:14.043591 (+ 275us) client_negotiation.cc:769] Sending connection context
0809 00:49:14.043800 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 00:49:14.044165 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":264,"threads_started":1}
I20260809 00:49:14.046430 20055 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41567
I20260809 00:49:14.046681 20055 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:14.047338 20055 heartbeater.cc:511] Master 127.28.92.190:41567 requested a full tablet report, sending...
I20260809 00:49:14.048712 19357 ts_manager.cc:194] Registered new tserver with Master: 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179)
I20260809 00:49:14.049746 19357 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:40145
I20260809 00:49:14.050771 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:49:14.067322 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.055163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35480 (local address 127.28.92.190:41567)
0809 00:49:14.055303 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.055309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.055747 (+ 438us) server_negotiation.cc:407] Connection header received
0809 00:49:14.055874 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.055878 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.055937 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.056013 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:14.057297 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.058141 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.059427 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.059881 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.059971 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.062287 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:14.062293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:14.062296 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:14.062326 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:14.064605 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.065281 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.065286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.065290 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.065442 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.065860 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.065865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.065869 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.066210 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:14.066459 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.066794 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.067009 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 00:49:14.070966 19357 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35480:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:49:14.078488 19357 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:49:14.111997 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.097343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39224 (local address 127.28.92.130:35921)
0809 00:49:14.097956 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.097966 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.102178 (+ 4212us) server_negotiation.cc:407] Connection header received
0809 00:49:14.102516 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.102526 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.102805 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.102981 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:14.103995 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.105724 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.108636 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.110303 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.110434 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.110653 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.111413 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.111626 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":261,"threads_started":1}
I20260809 00:49:14.113082 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.096630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:35921 (local address 127.0.0.1:39224)
0809 00:49:14.102066 (+ 5436us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.102083 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:14.102298 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:14.103300 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:14.103319 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:14.103351 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:14.103796 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.103809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.105929 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.105935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.108440 (+ 2505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.108457 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.110864 (+ 2407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.110872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.111111 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.111165 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 00:49:14.112413 (+ 1248us) client_negotiation.cc:240] Negotiation successful
0809 00:49:14.112669 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5318,"thread_start_us":5187,"threads_started":1}
I20260809 00:49:14.117602 19744 tablet_service.cc:1467] Processing CreateTablet for tablet 4a32f994c51e48d2931358d9ec578f63 (DEFAULT_TABLE table=test-table [id=0a11413ecf4042639dc085ecc6e71ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:14.119191 19744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a32f994c51e48d2931358d9ec578f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:14.121903 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.103239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41179 (local address 127.0.0.1:57076)
0809 00:49:14.113411 (+ 10172us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.113430 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:14.113536 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:14.114613 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:14.114617 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:14.114646 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:14.114798 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.114810 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.116740 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.116745 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.118621 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.118636 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.121091 (+ 2455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.121097 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.121274 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.121320 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 00:49:14.121410 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 00:49:14.121547 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10069,"mutex_wait_us":6,"thread_start_us":10067,"threads_started":1}
I20260809 00:49:14.122715 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.102540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57076 (local address 127.28.92.131:41179)
0809 00:49:14.103255 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.103264 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.113697 (+ 10433us) server_negotiation.cc:407] Connection header received
0809 00:49:14.113815 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.113824 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.114100 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.114288 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:14.114988 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.116569 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.118831 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.120629 (+ 1798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.120760 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.120988 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.122211 (+ 1223us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.122399 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":370,"threads_started":1}
I20260809 00:49:14.123963 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.095390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37304)
0809 00:49:14.097069 (+ 1679us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.097118 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:14.097291 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:14.115200 (+ 17909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:14.115205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:14.115230 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:14.115609 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.115622 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.117854 (+ 2232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.117860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.119972 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.119987 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.123218 (+ 3231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.123225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.123419 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.123452 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 00:49:14.123517 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 00:49:14.123649 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1296,"thread_start_us":1156,"threads_started":1}
I20260809 00:49:14.124981 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.097406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37304 (local address 127.28.92.129:33621)
0809 00:49:14.114324 (+ 16918us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.114345 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.114381 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:49:14.114507 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.114516 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.114783 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.115833 (+ 1050us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:14.116123 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.117698 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.121382 (+ 3684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.122961 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.124209 (+ 1248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.124447 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.124514 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.124669 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16703,"thread_start_us":17515,"threads_started":1}
I20260809 00:49:14.126751 19947 tablet_service.cc:1467] Processing CreateTablet for tablet 4a32f994c51e48d2931358d9ec578f63 (DEFAULT_TABLE table=test-table [id=0a11413ecf4042639dc085ecc6e71ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:14.128259 19947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a32f994c51e48d2931358d9ec578f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:14.128463 19550 tablet_service.cc:1467] Processing CreateTablet for tablet 4a32f994c51e48d2931358d9ec578f63 (DEFAULT_TABLE table=test-table [id=0a11413ecf4042639dc085ecc6e71ee1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:14.129932 19550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a32f994c51e48d2931358d9ec578f63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:14.144455 20080 tablet_bootstrap.cc:492] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Bootstrap starting.
I20260809 00:49:14.145195 20081 tablet_bootstrap.cc:492] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Bootstrap starting.
I20260809 00:49:14.148828 20081 tablet_bootstrap.cc:654] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:14.148828 20080 tablet_bootstrap.cc:654] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:14.150172 20081 log.cc:824] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:14.150228 20080 log.cc:824] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:14.153643 20088 tablet_bootstrap.cc:492] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Bootstrap starting.
I20260809 00:49:14.156209 20081 tablet_bootstrap.cc:492] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: No bootstrap required, opened a new log
I20260809 00:49:14.156523 20081 ts_tablet_manager.cc:1397] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260809 00:49:14.157519 20088 tablet_bootstrap.cc:654] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:14.158937 20088 log.cc:824] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:14.159976 20080 tablet_bootstrap.cc:492] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: No bootstrap required, opened a new log
I20260809 00:49:14.160295 20080 ts_tablet_manager.cc:1397] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.004s
I20260809 00:49:14.165233 20088 tablet_bootstrap.cc:492] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: No bootstrap required, opened a new log
I20260809 00:49:14.165514 20088 ts_tablet_manager.cc:1397] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260809 00:49:14.167011 20081 raft_consensus.cc:348] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.167479 20081 raft_consensus.cc:374] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:14.167584 20081 raft_consensus.cc:729] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4163ca7627424e96b00508df94acfd9e, State: Initialized, Role: FOLLOWER
I20260809 00:49:14.167969 20080 raft_consensus.cc:348] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.168315 20080 raft_consensus.cc:374] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:14.168411 20080 raft_consensus.cc:729] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557402c23feb4dca911bc3ed97393cdc, State: Initialized, Role: FOLLOWER
I20260809 00:49:14.168228 20081 consensus_queue.cc:260] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.168943 20080 consensus_queue.cc:260] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.176352 20088 raft_consensus.cc:348] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.176823 20088 raft_consensus.cc:374] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:14.176923 20088 raft_consensus.cc:729] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755cf7931dd45d6ac698c1b16d69752, State: Initialized, Role: FOLLOWER
I20260809 00:49:14.177667 20088 consensus_queue.cc:260] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.178943 20055 heartbeater.cc:503] Master 127.28.92.190:41567 was elected leader, sending a full tablet report...
I20260809 00:49:14.179665 20081 ts_tablet_manager.cc:1428] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Time spent starting tablet: real 0.023s user 0.008s sys 0.016s
I20260809 00:49:14.179857 20080 ts_tablet_manager.cc:1428] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Time spent starting tablet: real 0.019s user 0.007s sys 0.011s
I20260809 00:49:14.180892 19848 heartbeater.cc:503] Master 127.28.92.190:41567 was elected leader, sending a full tablet report...
I20260809 00:49:14.181282 20088 ts_tablet_manager.cc:1428] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Time spent starting tablet: real 0.016s user 0.011s sys 0.004s
W20260809 00:49:14.257552 19648 tablet.cc:2369] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:49:14.259513 19850 tablet.cc:2369] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:14.260080 20092 raft_consensus.cc:482] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:14.260394 20092 raft_consensus.cc:504] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.262282 20092 leader_election.cc:288] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621), 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179)
I20260809 00:49:14.269763 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.262628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:60155 (local address 127.28.92.129:33621)
0809 00:49:14.262835 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.262841 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.263825 (+ 984us) server_negotiation.cc:407] Connection header received
0809 00:49:14.264068 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.264072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.264135 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.264207 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:14.264959 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.265743 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.267958 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.268730 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.268857 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.268945 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.269363 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.269494 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:49:14.269802 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.262886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:46991 (local address 127.28.92.131:41179)
0809 00:49:14.263099 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.263106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.263851 (+ 745us) server_negotiation.cc:407] Connection header received
0809 00:49:14.264055 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.264063 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.264132 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.264221 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:14.264850 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.265856 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.267947 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.268763 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.268943 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.269026 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.269351 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.269485 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 00:49:14.269939 20094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.262956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41179 (local address 127.28.92.130:46991)
0809 00:49:14.263737 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.263752 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:14.263908 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:14.264248 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:14.264253 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:14.264283 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:14.264678 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.264689 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.266007 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.266012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.267786 (+ 1774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.267798 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.269008 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.269014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.269171 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.269219 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 00:49:14.269296 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 00:49:14.269433 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":112,"spinlock_wait_cycles":2688,"thread_start_us":454,"threads_started":1}
I20260809 00:49:14.270004 20093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.262762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.28.92.130:60155)
0809 00:49:14.263688 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.263710 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:14.263917 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:14.264252 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:14.264256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:14.264295 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:14.264798 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.264813 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.265878 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.265883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.267785 (+ 1902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:14.267799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.268974 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.268981 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:14.269168 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.269216 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 00:49:14.269320 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 00:49:14.269453 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":84,"spinlock_wait_cycles":74240,"thread_start_us":508,"threads_started":1}
I20260809 00:49:14.271119 19985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a32f994c51e48d2931358d9ec578f63" candidate_uuid: "a755cf7931dd45d6ac698c1b16d69752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4163ca7627424e96b00508df94acfd9e" is_pre_election: true
I20260809 00:49:14.271134 19581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a32f994c51e48d2931358d9ec578f63" candidate_uuid: "a755cf7931dd45d6ac698c1b16d69752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557402c23feb4dca911bc3ed97393cdc" is_pre_election: true
I20260809 00:49:14.271642 19985 raft_consensus.cc:2454] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a755cf7931dd45d6ac698c1b16d69752 in term 0.
I20260809 00:49:14.271654 19581 raft_consensus.cc:2454] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a755cf7931dd45d6ac698c1b16d69752 in term 0.
I20260809 00:49:14.272332 19676 leader_election.cc:302] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc, a755cf7931dd45d6ac698c1b16d69752; no voters:
I20260809 00:49:14.272733 20092 raft_consensus.cc:2781] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:49:14.272878 20092 raft_consensus.cc:482] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:49:14.272962 20092 raft_consensus.cc:3037] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:14.275385 20092 raft_consensus.cc:504] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.276054 20092 leader_election.cc:288] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [CANDIDATE]: Term 1 election: Requested vote from peers 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621), 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179)
W20260809 00:49:14.276476 20056 tablet.cc:2369] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:14.276484 19581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a32f994c51e48d2931358d9ec578f63" candidate_uuid: "a755cf7931dd45d6ac698c1b16d69752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557402c23feb4dca911bc3ed97393cdc"
I20260809 00:49:14.276666 19581 raft_consensus.cc:3037] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:14.277598 19985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a32f994c51e48d2931358d9ec578f63" candidate_uuid: "a755cf7931dd45d6ac698c1b16d69752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4163ca7627424e96b00508df94acfd9e"
I20260809 00:49:14.277850 19985 raft_consensus.cc:3037] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:14.278942 19581 raft_consensus.cc:2454] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a755cf7931dd45d6ac698c1b16d69752 in term 1.
I20260809 00:49:14.279321 19676 leader_election.cc:302] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc, a755cf7931dd45d6ac698c1b16d69752; no voters:
I20260809 00:49:14.279593 20092 raft_consensus.cc:2781] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:14.280042 20092 raft_consensus.cc:686] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 1 LEADER]: Becoming Leader. State: Replica: a755cf7931dd45d6ac698c1b16d69752, State: Running, Role: LEADER
I20260809 00:49:14.280450 19985 raft_consensus.cc:2454] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a755cf7931dd45d6ac698c1b16d69752 in term 1.
I20260809 00:49:14.280579 20092 consensus_queue.cc:237] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } }
I20260809 00:49:14.285156 19356 catalog_manager.cc:5495] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 reported cstate change: term changed from 0 to 1, leader changed from <none> to a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130). New cstate: current_term: 1 leader_uuid: "a755cf7931dd45d6ac698c1b16d69752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260809 00:49:14.301399 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.295617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39240 (local address 127.28.92.130:35921)
0809 00:49:14.295828 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.295834 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.295916 (+ 82us) server_negotiation.cc:407] Connection header received
0809 00:49:14.296158 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.296162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.296253 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.296395 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:49:14.296824 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.297559 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.299195 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.299642 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.299764 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.300299 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:49:14.300766 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:49:14.300921 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.301032 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.301117 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 00:49:14.309101 19581 raft_consensus.cc:1261] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Refusing update from remote peer a755cf7931dd45d6ac698c1b16d69752: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:14.309104 19985 raft_consensus.cc:1261] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Refusing update from remote peer a755cf7931dd45d6ac698c1b16d69752: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:14.310032 20095 consensus_queue.cc:1035] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:14.310392 20092 consensus_queue.cc:1035] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:14.334784 19356 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:14.335047 19356 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35480:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:14.338562 19356 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Sending DeleteTablet for 3 replicas of tablet 4a32f994c51e48d2931358d9ec578f63
I20260809 00:49:14.339669 19550 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a32f994c51e48d2931358d9ec578f63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:14 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:37304
I20260809 00:49:14.339689 19744 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a32f994c51e48d2931358d9ec578f63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:14 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:39224
I20260809 00:49:14.339689 19947 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a32f994c51e48d2931358d9ec578f63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:14 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:57076
I20260809 00:49:14.339809 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 19454
I20260809 00:49:14.352057 20114 tablet_replica.cc:330] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: stopping tablet replica
I20260809 00:49:14.352715 20112 tablet_replica.cc:330] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: stopping tablet replica
I20260809 00:49:14.353216 20112 raft_consensus.cc:2229] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:49:14.353998 20112 raft_consensus.cc:2258] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:14.355188 20114 raft_consensus.cc:2229] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:14.355688 20114 raft_consensus.cc:2258] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:14.358052 20114 ts_tablet_manager.cc:1905] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:14.360239 20111 tablet_replica.cc:330] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: stopping tablet replica
I20260809 00:49:14.361140 20112 ts_tablet_manager.cc:1905] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 00:49:14 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:49:14.363986 20111 raft_consensus.cc:2229] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:14.364598 20111 raft_consensus.cc:2258] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:14.365767 20114 ts_tablet_manager.cc:1918] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:14.365993 20114 log.cc:1196] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/4a32f994c51e48d2931358d9ec578f63
I20260809 00:49:14.366606 20114 ts_tablet_manager.cc:1939] T 4a32f994c51e48d2931358d9ec578f63 P 4163ca7627424e96b00508df94acfd9e: Deleting consensus metadata
I20260809 00:49:14.367534 20111 ts_tablet_manager.cc:1905] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:14.368655 19337 catalog_manager.cc:4841] TS 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): tablet 4a32f994c51e48d2931358d9ec578f63 (table test-table [id=0a11413ecf4042639dc085ecc6e71ee1]) successfully deleted
I20260809 00:49:14.373363 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.341055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.28.92.129:33621)
0809 00:49:14.341235 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.341242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.351915 (+ 10673us) server_negotiation.cc:407] Connection header received
0809 00:49:14.352407 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.352413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.352499 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.352605 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:14.354779 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.355974 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.358139 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.358924 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.359063 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.365140 (+ 6077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:14.365159 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:14.365178 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:14.365224 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:14.369300 (+ 4076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.370426 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.370436 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.370440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.370636 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.371154 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.371159 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.371163 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.371658 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:14.371991 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.372652 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.372929 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 00:49:14.373576 20112 ts_tablet_manager.cc:1918] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:14.373857 20112 log.cc:1196] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/4a32f994c51e48d2931358d9ec578f63
I20260809 00:49:14.374670 20112 ts_tablet_manager.cc:1939] T 4a32f994c51e48d2931358d9ec578f63 P a755cf7931dd45d6ac698c1b16d69752: Deleting consensus metadata
I20260809 00:49:14.374914 19640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:14.376636 19337 catalog_manager.cc:4841] TS a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): tablet 4a32f994c51e48d2931358d9ec578f63 (table test-table [id=0a11413ecf4042639dc085ecc6e71ee1]) successfully deleted
I20260809 00:49:14.477190 20111 ts_tablet_manager.cc:1918] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:14.477481 20111 log.cc:1196] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/4a32f994c51e48d2931358d9ec578f63
I20260809 00:49:14.477875 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 19454
W20260809 00:49:14.499249 19338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:33621 (error 108)
I20260809 00:49:14.500053 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 19655
I20260809 00:49:14.501418 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.500832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37334)
0809 00:49:14.501111 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.501244 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
W20260809 00:49:14.501719 19338 catalog_manager.cc:4584] TS 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a32f994c51e48d2931358d9ec578f63: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Aug 09 00:49:14 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:49:14.515880 20075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.500868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39244 (local address 127.28.92.130:35921)
0809 00:49:14.501049 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.501056 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.501187 (+ 131us) server_negotiation.cc:407] Connection header received
0809 00:49:14.501372 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.501377 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.501447 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.501537 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:14.502983 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.503805 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.505094 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.505552 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.505698 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.509849 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:14.509861 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:14.509873 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:14.509908 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:14.513040 (+ 3132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.513703 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.513711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.513713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.513866 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.514230 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.514237 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.514239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.514622 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:14.514957 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.515270 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.515514 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:49:14.516577 19841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:14.555470 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.554998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37342)
0809 00:49:14.555194 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.555287 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 00:49:14.556463 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.556134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37356)
0809 00:49:14.556260 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.556328 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 00:49:14.617007 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.616491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37368)
0809 00:49:14.616730 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.616822 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260809 00:49:14.618076 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.617712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37378)
0809 00:49:14.617882 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.617955 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 00:49:14.630043 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 19655
I20260809 00:49:14.652448 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 19856
Aug 09 00:49:14 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:49:14.666944 20078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.653142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57090 (local address 127.28.92.131:41179)
0809 00:49:14.653364 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:14.653370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:14.653392 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:49:14.653512 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:14.653515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:14.653590 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:14.653706 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:14.654939 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.655679 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.656933 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:14.657311 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:14.657394 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:14.661576 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:14.661590 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:14.661607 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:14.661640 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:14.664303 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.664933 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.664939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.664941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.665109 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:14.665483 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:14.665487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:14.665489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:14.665910 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:14.666172 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:14.666457 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 00:49:14.666629 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:49:14.667578 20047 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:14.699219 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.698752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37390)
0809 00:49:14.698965 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.699050 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 00:49:14.700225 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.699826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37398)
0809 00:49:14.700018 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.700103 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 00:49:14.754896 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 19856
I20260809 00:49:14.775878 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 19309
I20260809 00:49:14.777070 19406 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:14.886912 20073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:14.886150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37400)
0809 00:49:14.886367 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:14.886470 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 00:49:14.886965 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 19309
I20260809 00:49:14.913548 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41567
--webserver_interface=127.28.92.190
--webserver_port=42579
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:41567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:15.253984 20126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:15.254264 20126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:15.254393 20126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:15.261591 20126 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:15.261739 20126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:15.261824 20126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:15.261896 20126 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:15.261953 20126 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:15.272025 20126 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:41567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=42579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:15.273392 20126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:15.274729 20126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:15.302529 20136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:15.302496 20140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:15.302543 20137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:15.303310 20126 server_base.cc:1034] running on GCE node
I20260809 00:49:15.304225 20126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:15.305866 20126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:15.307086 20126 hybrid_clock.cc:648] HybridClock initialized: now 1786236555307027 us; error 47 us; skew 500 ppm
I20260809 00:49:15.307477 20126 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:15 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:15.313647 20126 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:15.315744 20126 webserver.cc:460] Webserver started at http://127.28.92.190:42579/ using document root <none> and password file <none>
I20260809 00:49:15.316526 20126 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:15.316655 20126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:15.322871 20126 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 00:49:15.325876 20149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:15.327334 20126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:49:15.327510 20126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "0b45b374ed744bcba937b70913a7ce05"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "457381c87e94a9fddcf9334c4ad20409"
server_key_iv: "94df42f49d86acdacdf6677c7424583d"
server_key_version: "encryptionkey@0"
I20260809 00:49:15.328603 20126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:15.352598 20126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:15.357286 20126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:15.357565 20126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:15.376173 20126 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:41567
I20260809 00:49:15.376196 20220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:41567 every 8 connection(s)
I20260809 00:49:15.377672 20126 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:15.379900 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 20126
I20260809 00:49:15.380858 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:33621
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:41567
--webserver_port=41265
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:49:15.386965 20221 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:49:15.391503 20221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap starting.
I20260809 00:49:15.412348 20221 log.cc:824] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:15.425321 20221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:49:15.425932 20221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap complete.
I20260809 00:49:15.435683 20221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:15.436545 20221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45b374ed744bcba937b70913a7ce05, State: Initialized, Role: FOLLOWER
I20260809 00:49:15.437156 20221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:15.437381 20221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:49:15.437501 20221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:49:15.437714 20221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 1 FOLLOWER]: Advancing to term 2
I20260809 00:49:15.441597 20221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:15.442198 20221 leader_election.cc:302] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b45b374ed744bcba937b70913a7ce05; no voters:
I20260809 00:49:15.442812 20221 leader_election.cc:288] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 00:49:15.442957 20228 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 00:49:15.444180 20228 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 LEADER]: Becoming Leader. State: Replica: 0b45b374ed744bcba937b70913a7ce05, State: Running, Role: LEADER
I20260809 00:49:15.444763 20228 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:15.445106 20221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:15.447201 20231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b45b374ed744bcba937b70913a7ce05. Latest consensus state: current_term: 2 leader_uuid: "0b45b374ed744bcba937b70913a7ce05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } } }
I20260809 00:49:15.447912 20231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:15.447532 20230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0b45b374ed744bcba937b70913a7ce05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } } }
I20260809 00:49:15.448447 20230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:15.451099 20239 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:15.460253 20239 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:15.461827 20239 catalog_manager.cc:1259] Loaded cluster ID: 48526bd574534ec191135816d344422d
I20260809 00:49:15.461956 20239 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:49:15.466153 20239 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 00:49:15.485617 20239 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 00:49:15.506700 20239 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:49:15.508739 20239 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Loaded TSK: 0
I20260809 00:49:15.510480 20239 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 00:49:15.758836 20223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:15.759136 20223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:15.759254 20223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:15.766645 20223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:15.766773 20223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:15.766928 20223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:49:15.777011 20223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:33621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=41265
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:15.778468 20223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:15.779811 20223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:15.794624 20265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:15.794732 20264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:15.795316 20267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:15.795785 20223 server_base.cc:1034] running on GCE node
I20260809 00:49:15.796605 20223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:15.797905 20223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:15.799165 20223 hybrid_clock.cc:648] HybridClock initialized: now 1786236555799105 us; error 44 us; skew 500 ppm
I20260809 00:49:15.799556 20223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:15 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:15.803445 20223 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:49:15.805204 20223 webserver.cc:460] Webserver started at http://127.28.92.129:41265/ using document root <none> and password file <none>
I20260809 00:49:15.806145 20223 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:15.806314 20223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:15.813184 20223 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 00:49:15.816551 20277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:15.818271 20223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 00:49:15.818451 20223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "557402c23feb4dca911bc3ed97393cdc"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "794e7c4bd6653030cbcaf5a3a1281fcf"
server_key_iv: "ad966330d806e5f10f7aeef5ac1c6e0f"
server_key_version: "encryptionkey@0"
I20260809 00:49:15.819798 20223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:15.836591 20223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:15.841777 20223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:15.842067 20223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:15.843232 20223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:15.846078 20286 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 00:49:15.854120 20286 ts_tablet_manager.cc:1852] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 00:49:15.855310 20286 ts_tablet_manager.cc:1905] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:15.863227 20286 ts_tablet_manager.cc:1918] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:15.863519 20286 ts_tablet_manager.cc:1939] T 4a32f994c51e48d2931358d9ec578f63 P 557402c23feb4dca911bc3ed97393cdc: Deleting consensus metadata
I20260809 00:49:15.863909 20223 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 00:49:15.864028 20223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.019s user 0.000s sys 0.001s
I20260809 00:49:15.864157 20223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:15.864226 20223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:15.894479 20223 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:33621
I20260809 00:49:15.894526 20436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:33621 every 8 connection(s)
I20260809 00:49:15.895815 20223 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:49:15.901187 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 20223
I20260809 00:49:15.901958 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:35921
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:41567
--webserver_port=34067
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:49:15 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236555, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:15.922114 20442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:15.898799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:45133)
0809 00:49:15.899623 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:15.899675 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:15.901878 (+ 2203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:15.903326 (+ 1448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:15.903337 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:15.904052 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:15.904798 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:15.904822 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:15.906685 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:15.906690 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:15.908591 (+ 1901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:15.908608 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:15.910434 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:15.910444 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:15.910736 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:15.911565 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:15.911597 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:15.914243 (+ 2646us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:15.917636 (+ 3393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:15.917646 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:15.917700 (+ 54us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:15.918152 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:15.918595 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:15.918600 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:15.918604 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:15.918789 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:15.919574 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:15.919582 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:15.919914 (+ 332us) client_negotiation.cc:769] Sending connection context
0809 00:49:15.920159 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 00:49:15.920743 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":320,"threads_started":1}
I20260809 00:49:15.922114 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:15.898616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:45133 (local address 127.28.92.190:41567)
0809 00:49:15.899230 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:15.899242 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:15.899791 (+ 549us) server_negotiation.cc:407] Connection header received
0809 00:49:15.902480 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:15.902493 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:15.902813 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:15.903111 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:15.905067 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:15.906503 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:15.908736 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:15.909823 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:15.910034 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:15.914546 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:15.914555 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:15.914572 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:15.914611 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:15.917479 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:15.918296 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:15.918303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:15.918308 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:15.918479 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:15.918906 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:15.918910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:15.918912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:15.919428 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:15.919617 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:15.920421 (+ 804us) server_negotiation.cc:299] Negotiation successful
0809 00:49:15.920804 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":267,"threads_started":1}
I20260809 00:49:15.924888 20437 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41567
I20260809 00:49:15.925202 20437 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:15.925935 20437 heartbeater.cc:511] Master 127.28.92.190:41567 requested a full tablet report, sending...
I20260809 00:49:15.927989 20175 ts_manager.cc:194] Registered new tserver with Master: 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621)
I20260809 00:49:15.929409 20175 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:45133
W20260809 00:49:16.240744 20443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:16.241083 20443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:16.241231 20443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:16.248593 20443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:16.248720 20443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:16.248874 20443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:49:16.258849 20443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:35921
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=34067
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:16.260179 20443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:16.261507 20443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:16.274151 20450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:16.274104 20451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:16.274333 20453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:16.275077 20443 server_base.cc:1034] running on GCE node
I20260809 00:49:16.275656 20443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:16.276511 20443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:16.277727 20443 hybrid_clock.cc:648] HybridClock initialized: now 1786236556277680 us; error 34 us; skew 500 ppm
I20260809 00:49:16.278028 20443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:16 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:16.281150 20443 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:49:16.282582 20443 webserver.cc:460] Webserver started at http://127.28.92.130:34067/ using document root <none> and password file <none>
I20260809 00:49:16.283262 20443 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:16.283411 20443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:16.288738 20443 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:49:16.291453 20463 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:16.292719 20443 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:49:16.292897 20443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "a755cf7931dd45d6ac698c1b16d69752"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "d7e28cd2a614c6093437cdfe845c8925"
server_key_iv: "84ef9f895ff7649fc1308808089101f8"
server_key_version: "encryptionkey@0"
I20260809 00:49:16.293927 20443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:16.306331 20443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:16.310750 20443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:16.311034 20443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:16.312054 20443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:16.313439 20443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:16.313558 20443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:16.313692 20443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:16.313783 20443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260809 00:49:16.343107 20443 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:35921
I20260809 00:49:16.343173 20622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:35921 every 8 connection(s)
I20260809 00:49:16.344521 20443 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:49:16.350503 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 20443
I20260809 00:49:16.351255 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:41179
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:41567
--webserver_port=43331
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:49:16 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:16.366216 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.347083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:55083 (local address 127.28.92.190:41567)
0809 00:49:16.347258 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.347263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.348454 (+ 1191us) server_negotiation.cc:407] Connection header received
0809 00:49:16.350375 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.350385 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.350476 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.350562 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:16.352575 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.353417 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.355549 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.355983 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.356080 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.360109 (+ 4029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:16.360115 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:16.360118 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:16.360152 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:16.363013 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:16.363749 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:16.363755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:16.363757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:16.363923 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:16.364411 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:16.364416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:16.364419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:16.364786 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:16.364935 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.365619 (+ 684us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.365895 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:49:16.367003 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.347584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:55083)
0809 00:49:16.348296 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:16.348333 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:16.350053 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:16.350844 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:16.350856 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:16.351590 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:16.352384 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.352421 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.353577 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.353582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.355389 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.355404 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.356204 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.356210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.356485 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.357194 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:16.357221 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:16.359888 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:16.363157 (+ 3269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:16.363165 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:16.363177 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:16.363609 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:16.364051 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:16.364055 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:16.364058 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:16.364291 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:16.364906 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:16.364918 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:16.365242 (+ 324us) client_negotiation.cc:769] Sending connection context
0809 00:49:16.365472 (+ 230us) client_negotiation.cc:240] Negotiation successful
0809 00:49:16.365907 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":283,"threads_started":1}
I20260809 00:49:16.368626 20623 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41567
I20260809 00:49:16.368976 20623 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:16.369773 20623 heartbeater.cc:511] Master 127.28.92.190:41567 requested a full tablet report, sending...
I20260809 00:49:16.371227 20175 ts_manager.cc:194] Registered new tserver with Master: a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
I20260809 00:49:16.372038 20175 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:55083
W20260809 00:49:16.681068 20626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:16.681344 20626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:16.681485 20626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:16.688540 20626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:16.688649 20626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:16.688805 20626 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:49:16.698127 20626 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:41179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=43331
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:16.699467 20626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:16.700708 20626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:16.713299 20634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:16.713398 20633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:16.713379 20636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:16.714265 20626 server_base.cc:1034] running on GCE node
I20260809 00:49:16.714890 20626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:16.715886 20626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:16.717109 20626 hybrid_clock.cc:648] HybridClock initialized: now 1786236556717054 us; error 48 us; skew 500 ppm
I20260809 00:49:16.717428 20626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:16 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:16.720606 20626 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:49:16.722214 20626 webserver.cc:460] Webserver started at http://127.28.92.131:43331/ using document root <none> and password file <none>
I20260809 00:49:16.722922 20626 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:16.723059 20626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:16.728420 20626 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:49:16.731112 20647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:16.732455 20626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:49:16.732616 20626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "4163ca7627424e96b00508df94acfd9e"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "72052885ee78d93e5b00d440a88ed001"
server_key_iv: "8529096b9a03e2327b2e466f3cab5e3d"
server_key_version: "encryptionkey@0"
I20260809 00:49:16.733610 20626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:16.748134 20626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:16.752491 20626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:16.752741 20626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:16.753784 20626 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:16.755234 20626 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:16.755344 20626 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:16.755451 20626 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:16.755537 20626 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:16.786381 20626 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41179
I20260809 00:49:16.786454 20813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41179 every 8 connection(s)
I20260809 00:49:16.787835 20626 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:49:16.789820 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 20626
Aug 09 00:49:16 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236556, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:16.806409 20816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.790743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35486 (local address 127.28.92.190:41567)
0809 00:49:16.791293 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.791298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.791675 (+ 377us) server_negotiation.cc:407] Connection header received
0809 00:49:16.791869 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.791874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.791968 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.792082 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:16.794060 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.794949 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.796730 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.797464 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.797588 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.800815 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:16.800820 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:16.800823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:16.800853 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:16.803684 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:16.804369 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:16.804373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:16.804375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:16.804507 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:16.804875 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:16.804881 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:16.804883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:16.805180 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:16.805448 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.805748 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.805973 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":445,"thread_start_us":325,"threads_started":1}
I20260809 00:49:16.809576 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.790482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:39597 (local address 127.28.92.190:41567)
0809 00:49:16.790683 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.790689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.792116 (+ 1427us) server_negotiation.cc:407] Connection header received
0809 00:49:16.794533 (+ 2417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.794539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.794614 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.794719 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:16.796473 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.797512 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.799748 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.800163 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.800257 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.803909 (+ 3652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:16.803922 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:16.803925 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:16.803954 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:16.806552 (+ 2598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:16.807276 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:16.807279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:16.807282 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:16.807398 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:16.807871 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:16.807876 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:16.807880 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:16.808155 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:16.808287 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.809024 (+ 737us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.809239 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":72}
I20260809 00:49:16.810568 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.791139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:39597)
0809 00:49:16.791977 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:16.792019 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:16.794295 (+ 2276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:16.794887 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:16.794894 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:16.795583 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:16.796298 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.796333 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.797699 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.797704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.799608 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.799623 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.800387 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.800395 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.800687 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.801328 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:16.801350 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:16.803722 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:16.806703 (+ 2981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:16.806713 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:16.806732 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:16.807160 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:16.807500 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:16.807504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:16.807507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:16.807743 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:16.808283 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:16.808292 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:16.808645 (+ 353us) client_negotiation.cc:769] Sending connection context
0809 00:49:16.808884 (+ 239us) client_negotiation.cc:240] Negotiation successful
0809 00:49:16.809428 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":325,"threads_started":1}
I20260809 00:49:16.811957 20814 heartbeater.cc:347] Connected to a master server at 127.28.92.190:41567
I20260809 00:49:16.812294 20814 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:16.813102 20814 heartbeater.cc:511] Master 127.28.92.190:41567 requested a full tablet report, sending...
I20260809 00:49:16.814639 20175 ts_manager.cc:194] Registered new tserver with Master: 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179)
I20260809 00:49:16.815436 20175 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:39597
I20260809 00:49:16.821238 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:49:16.828200 20441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.822196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35500 (local address 127.28.92.190:41567)
0809 00:49:16.822356 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.822360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.822866 (+ 506us) server_negotiation.cc:407] Connection header received
0809 00:49:16.823087 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.823091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.823236 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.823364 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:49:16.823807 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.824536 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.826088 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.826500 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.826612 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.827135 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:49:16.827639 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:49:16.827767 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.827877 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.827962 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 00:49:16.829154 20175 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:49:16.836380 20175 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:49:16.872413 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.848215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37408 (local address 127.28.92.129:33621)
0809 00:49:16.860784 (+ 12569us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.860792 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.862180 (+ 1388us) server_negotiation.cc:407] Connection header received
0809 00:49:16.862789 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.862797 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.863028 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.863184 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:16.864604 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.866245 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.868953 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.871098 (+ 2145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.871189 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.871407 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.871922 (+ 515us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.872087 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12433,"thread_start_us":12356,"threads_started":1}
I20260809 00:49:16.872550 20826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.847773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41179 (local address 127.0.0.1:57094)
0809 00:49:16.861079 (+ 13306us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:16.861125 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:16.861319 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:16.862352 (+ 1033us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:16.862361 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:16.862396 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:16.862861 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.862873 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.865627 (+ 2754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.865633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.868234 (+ 2601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.868252 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.871630 (+ 3378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.871637 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.871824 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.871860 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:49:16.871947 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 00:49:16.872088 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13070,"mutex_wait_us":1,"thread_start_us":12768,"threads_started":1}
I20260809 00:49:16.872701 20827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.847954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57094 (local address 127.28.92.131:41179)
0809 00:49:16.860546 (+ 12592us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.860556 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.861240 (+ 684us) server_negotiation.cc:407] Connection header received
0809 00:49:16.861524 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.861532 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.861818 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.862012 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:16.863099 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.865394 (+ 2295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.868469 (+ 3075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.871076 (+ 2607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.871206 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.871446 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.872226 (+ 780us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.872385 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12413,"thread_start_us":12234,"threads_started":1}
I20260809 00:49:16.873180 20825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.847934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37408)
0809 00:49:16.862058 (+ 14124us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:16.862077 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:16.862578 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:16.863425 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:16.863430 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:16.863999 (+ 569us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:16.864396 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.864410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.866453 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.866459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.868747 (+ 2288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.868764 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.871565 (+ 2801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.871569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.871714 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.871750 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:49:16.871856 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 00:49:16.872037 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13999,"mutex_wait_us":27,"thread_start_us":12625,"threads_started":1}
I20260809 00:49:16.875113 20346 tablet_service.cc:1467] Processing CreateTablet for tablet 3a09db2d6a494eac9f6c5ece595483cc (DEFAULT_TABLE table=test-table [id=51e1165c24434477b0becc3cf1e21279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:16.876502 20346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a09db2d6a494eac9f6c5ece595483cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:16.876579 20710 tablet_service.cc:1467] Processing CreateTablet for tablet 3a09db2d6a494eac9f6c5ece595483cc (DEFAULT_TABLE table=test-table [id=51e1165c24434477b0becc3cf1e21279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:16.877867 20710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a09db2d6a494eac9f6c5ece595483cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:16.882099 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.861768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:35921 (local address 127.0.0.1:39250)
0809 00:49:16.871050 (+ 9282us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:16.871068 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:16.871175 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:16.875081 (+ 3906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:16.875086 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:16.875112 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:16.875420 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.875433 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.877239 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.877245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.879526 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:16.879542 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.881314 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.881320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:16.881489 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.881522 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 00:49:16.881624 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 00:49:16.881775 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9140,"thread_start_us":9467,"threads_started":1}
I20260809 00:49:16.882151 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:16.861964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39250 (local address 127.28.92.130:35921)
0809 00:49:16.874505 (+ 12541us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:16.874514 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:16.874548 (+ 34us) server_negotiation.cc:407] Connection header received
0809 00:49:16.874640 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:16.874648 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:16.874883 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:16.875065 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:16.875625 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.877055 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.879702 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:16.881084 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:16.881229 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:16.881423 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:16.881695 (+ 272us) server_negotiation.cc:299] Negotiation successful
0809 00:49:16.881868 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12379,"thread_start_us":12254,"threads_started":1}
I20260809 00:49:16.885545 20833 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Bootstrap starting.
I20260809 00:49:16.886159 20532 tablet_service.cc:1467] Processing CreateTablet for tablet 3a09db2d6a494eac9f6c5ece595483cc (DEFAULT_TABLE table=test-table [id=51e1165c24434477b0becc3cf1e21279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:16.887300 20532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3a09db2d6a494eac9f6c5ece595483cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:16.889207 20833 tablet_bootstrap.cc:654] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:16.890905 20833 log.cc:824] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:16.891808 20836 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Bootstrap starting.
I20260809 00:49:16.895349 20836 tablet_bootstrap.cc:654] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:16.896678 20836 log.cc:824] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:16.900254 20833 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: No bootstrap required, opened a new log
I20260809 00:49:16.901672 20833 ts_tablet_manager.cc:1397] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260809 00:49:16.911751 20833 raft_consensus.cc:348] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:16.912175 20833 raft_consensus.cc:374] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:16.912289 20833 raft_consensus.cc:729] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557402c23feb4dca911bc3ed97393cdc, State: Initialized, Role: FOLLOWER
I20260809 00:49:16.912657 20836 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: No bootstrap required, opened a new log
I20260809 00:49:16.913034 20836 ts_tablet_manager.cc:1397] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.012s
I20260809 00:49:16.915325 20844 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Bootstrap starting.
I20260809 00:49:16.913028 20833 consensus_queue.cc:260] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:16.916940 20437 heartbeater.cc:503] Master 127.28.92.190:41567 was elected leader, sending a full tablet report...
I20260809 00:49:16.917644 20833 ts_tablet_manager.cc:1428] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Time spent starting tablet: real 0.016s user 0.007s sys 0.005s
I20260809 00:49:16.919122 20844 tablet_bootstrap.cc:654] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:16.920457 20844 log.cc:824] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:16.922454 20836 raft_consensus.cc:348] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:16.922904 20836 raft_consensus.cc:374] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:16.923008 20836 raft_consensus.cc:729] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4163ca7627424e96b00508df94acfd9e, State: Initialized, Role: FOLLOWER
I20260809 00:49:16.923714 20836 consensus_queue.cc:260] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:16.924218 20844 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: No bootstrap required, opened a new log
I20260809 00:49:16.924531 20844 ts_tablet_manager.cc:1397] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 00:49:16.924818 20814 heartbeater.cc:503] Master 127.28.92.190:41567 was elected leader, sending a full tablet report...
I20260809 00:49:16.925446 20836 ts_tablet_manager.cc:1428] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260809 00:49:16.931989 20844 raft_consensus.cc:348] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:16.932334 20844 raft_consensus.cc:374] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:16.932436 20844 raft_consensus.cc:729] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a755cf7931dd45d6ac698c1b16d69752, State: Initialized, Role: FOLLOWER
I20260809 00:49:16.932951 20844 consensus_queue.cc:260] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:16.933980 20623 heartbeater.cc:503] Master 127.28.92.190:41567 was elected leader, sending a full tablet report...
I20260809 00:49:16.934576 20844 ts_tablet_manager.cc:1428] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260809 00:49:17.007122 20848 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:17.007440 20848 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:17.009104 20848 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
I20260809 00:49:17.015710 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.009436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.28.92.131:51309)
0809 00:49:17.009796 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.009815 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:17.009955 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:17.010358 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:17.010363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:17.010391 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:17.010596 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:17.010607 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.011811 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.011814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:17.013778 (+ 1964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:17.013794 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.015100 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.015104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:17.015230 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.015254 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:49:17.015322 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 00:49:17.015413 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"mutex_wait_us":1}
I20260809 00:49:17.015758 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.009637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:51309 (local address 127.28.92.129:33621)
0809 00:49:17.009883 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:17.009889 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:17.009911 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:49:17.010120 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:17.010125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:17.010205 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:17.010308 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:17.010727 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.011674 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.013932 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.014956 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.015110 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.015186 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:17.015366 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 00:49:17.015509 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260809 00:49:17.016312 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.009581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:42663 (local address 127.28.92.130:35921)
0809 00:49:17.009801 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:17.009807 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:17.010482 (+ 675us) server_negotiation.cc:407] Connection header received
0809 00:49:17.010622 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:17.010626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:17.010697 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:17.010791 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:17.011248 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.012101 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.014315 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.015494 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.015642 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.015709 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:17.016036 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 00:49:17.016135 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 00:49:17.016891 20851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.009607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:35921 (local address 127.28.92.131:42663)
0809 00:49:17.010377 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.010393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:17.010509 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:17.010809 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:17.010812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:17.010831 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:17.011098 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:17.011105 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.012257 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.012262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:17.014170 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:17.014180 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.015680 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.015685 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:17.015846 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.015876 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 00:49:17.016492 (+ 616us) client_negotiation.cc:240] Negotiation successful
0809 00:49:17.016617 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"mutex_wait_us":26,"thread_start_us":420,"threads_started":1}
I20260809 00:49:17.016772 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a09db2d6a494eac9f6c5ece595483cc" candidate_uuid: "4163ca7627424e96b00508df94acfd9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557402c23feb4dca911bc3ed97393cdc" is_pre_election: true
I20260809 00:49:17.017304 20371 raft_consensus.cc:2454] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4163ca7627424e96b00508df94acfd9e in term 0.
I20260809 00:49:17.017880 20557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a09db2d6a494eac9f6c5ece595483cc" candidate_uuid: "4163ca7627424e96b00508df94acfd9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755cf7931dd45d6ac698c1b16d69752" is_pre_election: true
I20260809 00:49:17.017994 20651 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4163ca7627424e96b00508df94acfd9e, 557402c23feb4dca911bc3ed97393cdc; no voters:
I20260809 00:49:17.018389 20848 raft_consensus.cc:2781] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:49:17.018397 20557 raft_consensus.cc:2454] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4163ca7627424e96b00508df94acfd9e in term 0.
I20260809 00:49:17.018519 20848 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:49:17.018610 20848 raft_consensus.cc:3037] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:17.020889 20848 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:17.021457 20848 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [CANDIDATE]: Term 1 election: Requested vote from peers 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
I20260809 00:49:17.021899 20371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a09db2d6a494eac9f6c5ece595483cc" candidate_uuid: "4163ca7627424e96b00508df94acfd9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "557402c23feb4dca911bc3ed97393cdc"
I20260809 00:49:17.021979 20557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3a09db2d6a494eac9f6c5ece595483cc" candidate_uuid: "4163ca7627424e96b00508df94acfd9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a755cf7931dd45d6ac698c1b16d69752"
I20260809 00:49:17.022080 20371 raft_consensus.cc:3037] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:17.022167 20557 raft_consensus.cc:3037] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:17.024315 20371 raft_consensus.cc:2454] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4163ca7627424e96b00508df94acfd9e in term 1.
I20260809 00:49:17.024408 20557 raft_consensus.cc:2454] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4163ca7627424e96b00508df94acfd9e in term 1.
I20260809 00:49:17.024675 20651 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4163ca7627424e96b00508df94acfd9e, 557402c23feb4dca911bc3ed97393cdc; no voters:
I20260809 00:49:17.024948 20848 raft_consensus.cc:2781] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:17.025373 20848 raft_consensus.cc:686] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 1 LEADER]: Becoming Leader. State: Replica: 4163ca7627424e96b00508df94acfd9e, State: Running, Role: LEADER
I20260809 00:49:17.025941 20848 consensus_queue.cc:237] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:17.030488 20175 catalog_manager.cc:5495] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4163ca7627424e96b00508df94acfd9e (127.28.92.131). New cstate: current_term: 1 leader_uuid: "4163ca7627424e96b00508df94acfd9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } health_report { overall_health: UNKNOWN } } }
W20260809 00:49:17.039386 20815 tablet.cc:2369] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:17.051560 20827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.046702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57104 (local address 127.28.92.131:41179)
0809 00:49:17.046883 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:17.046887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:17.046906 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:49:17.047144 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:17.047150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:17.047232 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:17.047375 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:49:17.047657 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.048372 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.049710 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.050101 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.050189 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.050604 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:49:17.051099 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:49:17.051204 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:17.051244 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 00:49:17.051308 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 00:49:17.059688 20371 raft_consensus.cc:1261] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Refusing update from remote peer 4163ca7627424e96b00508df94acfd9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:17.059698 20557 raft_consensus.cc:1261] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Refusing update from remote peer 4163ca7627424e96b00508df94acfd9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:17.060599 20852 consensus_queue.cc:1035] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:17.060981 20848 consensus_queue.cc:1035] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:17.071553 20855 mvcc.cc:205] Tried to move back new op lower bound from 7316424937706979328 to 7316424937582616576. Current Snapshot: MvccSnapshot[applied={T|T < 7316424937706979328}]
I20260809 00:49:17.076220 20856 mvcc.cc:205] Tried to move back new op lower bound from 7316424937706979328 to 7316424937582616576. Current Snapshot: MvccSnapshot[applied={T|T < 7316424937706979328}]
I20260809 00:49:17.086122 20175 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:17.086395 20175 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:17.089928 20175 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Sending DeleteTablet for 3 replicas of tablet 3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:17.091043 20710 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a09db2d6a494eac9f6c5ece595483cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:17 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:57094
I20260809 00:49:17.091172 20346 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a09db2d6a494eac9f6c5ece595483cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:17 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:37408
I20260809 00:49:17.091423 20532 tablet_service.cc:1514] Processing DeleteTablet for tablet 3a09db2d6a494eac9f6c5ece595483cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:17 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:39250
I20260809 00:49:17.092568 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 20223
I20260809 00:49:17.111241 20829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.093440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37414 (local address 127.28.92.129:33621)
0809 00:49:17.093625 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:17.093632 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:17.093792 (+ 160us) server_negotiation.cc:407] Connection header received
0809 00:49:17.093974 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:17.093980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:17.094063 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:17.094184 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:17.096088 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.097216 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.099385 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.100008 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.100142 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.103765 (+ 3623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:17.103786 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:17.103808 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:17.103852 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:17.107958 (+ 4106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:17.108871 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:17.108882 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:17.108886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:17.109069 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:17.109475 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:17.109481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:17.109484 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:17.110046 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:17.110357 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:17.110643 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 00:49:17.110892 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:49:17.112362 20431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:17.113227 20869 tablet_replica.cc:330] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: stopping tablet replica
I20260809 00:49:17.113812 20869 raft_consensus.cc:2229] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:49:17.114570 20869 raft_consensus.cc:2258] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:17.115499 20872 tablet_replica.cc:330] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: stopping tablet replica
I20260809 00:49:17.115944 20872 raft_consensus.cc:2229] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:17.116515 20872 raft_consensus.cc:2258] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:17.118584 20869 ts_tablet_manager.cc:1905] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:17.118908 20872 ts_tablet_manager.cc:1905] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:17.126226 20872 ts_tablet_manager.cc:1918] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:17.126538 20872 log.cc:1196] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:17.126953 20869 ts_tablet_manager.cc:1918] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:17.127130 20869 log.cc:1196] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:17.127383 20872 ts_tablet_manager.cc:1939] T 3a09db2d6a494eac9f6c5ece595483cc P a755cf7931dd45d6ac698c1b16d69752: Deleting consensus metadata
I20260809 00:49:17.127696 20869 ts_tablet_manager.cc:1939] T 3a09db2d6a494eac9f6c5ece595483cc P 4163ca7627424e96b00508df94acfd9e: Deleting consensus metadata
I20260809 00:49:17.129567 20153 catalog_manager.cc:4841] TS a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): tablet 3a09db2d6a494eac9f6c5ece595483cc (table test-table [id=51e1165c24434477b0becc3cf1e21279]) successfully deleted
I20260809 00:49:17.129971 20153 catalog_manager.cc:4841] TS 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): tablet 3a09db2d6a494eac9f6c5ece595483cc (table test-table [id=51e1165c24434477b0becc3cf1e21279]) successfully deleted
I20260809 00:49:17.215791 20870 tablet_replica.cc:330] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: stopping tablet replica
I20260809 00:49:17.216521 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 20223
I20260809 00:49:17.247217 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 20443
W20260809 00:49:17.247227 20156 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:33621 (error 108)
I20260809 00:49:17.249487 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.249048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37420)
0809 00:49:17.249232 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.249329 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 00:49:17.249864 20156 catalog_manager.cc:4584] TS 557402c23feb4dca911bc3ed97393cdc (127.28.92.129:33621): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3a09db2d6a494eac9f6c5ece595483cc: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
I20260809 00:49:17.264029 20832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.248120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39256 (local address 127.28.92.130:35921)
0809 00:49:17.248318 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:17.248325 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:17.249253 (+ 928us) server_negotiation.cc:407] Connection header received
0809 00:49:17.249337 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:17.249343 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:17.249439 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:17.249543 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:17.251070 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.252227 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.253742 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.254419 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.254548 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.257148 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:17.257168 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:17.257190 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:17.257235 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:17.260943 (+ 3708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:17.261809 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:17.261817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:17.261819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:17.261973 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:17.262365 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:17.262369 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:17.262371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:17.262793 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:17.263091 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:17.263410 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 00:49:17.263634 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:49:17.264771 20616 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:17.303598 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.303004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37434)
0809 00:49:17.303253 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.303387 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 00:49:17.304754 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.304361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37440)
0809 00:49:17.304512 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.304599 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 00:49:17.361699 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 20443
I20260809 00:49:17.365564 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.364991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37450)
0809 00:49:17.365243 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.365360 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 00:49:17.366780 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.366373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37460)
0809 00:49:17.366536 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.366628 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 00:49:17.385298 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 20626
I20260809 00:49:17.399673 20827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.386079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57120 (local address 127.28.92.131:41179)
0809 00:49:17.386270 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:17.386276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:17.386303 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:49:17.386462 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:17.386467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:17.386544 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:17.386627 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:17.388061 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.388899 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.390234 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:17.390704 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:17.390812 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:17.393489 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:17.393502 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:17.393519 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:17.393559 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:17.396581 (+ 3022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:17.397294 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:17.397302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:17.397304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:17.397486 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:17.397899 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:17.397904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:17.397907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:17.398287 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:17.398610 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:17.398914 (+ 304us) server_negotiation.cc:299] Negotiation successful
0809 00:49:17.399133 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 00:49:17.400355 20805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:17.447631 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.447063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37466)
0809 00:49:17.447307 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.447427 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260809 00:49:17.448798 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.448355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37468)
0809 00:49:17.448571 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.448661 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 00:49:17.522720 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 20626
I20260809 00:49:17.548154 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 20126
I20260809 00:49:17.549301 20216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:17.663285 20830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:17.662685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33621 (local address 127.0.0.1:37484)
0809 00:49:17.662863 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:17.662958 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:33621: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 00:49:17.664083 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 20126
I20260809 00:49:17.692768 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41567
--webserver_interface=127.28.92.190
--webserver_port=42579
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:41567
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:18.035420 20879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:18.035773 20879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:18.035921 20879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:18.043463 20879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:18.043603 20879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:18.043680 20879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:18.043761 20879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:18.043829 20879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:18.054949 20879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:41567
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=42579
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:18.056357 20879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:18.057634 20879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:18.069497 20887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:18.069547 20888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:18.069461 20893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:18.070736 20879 server_base.cc:1034] running on GCE node
I20260809 00:49:18.071736 20879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:18.073398 20879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:18.074672 20879 hybrid_clock.cc:648] HybridClock initialized: now 1786236558074612 us; error 45 us; skew 500 ppm
I20260809 00:49:18.075042 20879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:18 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236558, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:18.078341 20879 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:18.079893 20879 webserver.cc:460] Webserver started at http://127.28.92.190:42579/ using document root <none> and password file <none>
I20260809 00:49:18.080621 20879 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:18.080751 20879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:18.086540 20879 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 00:49:18.089488 20905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:18.090914 20879 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:49:18.091096 20879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "0b45b374ed744bcba937b70913a7ce05"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "457381c87e94a9fddcf9334c4ad20409"
server_key_iv: "94df42f49d86acdacdf6677c7424583d"
server_key_version: "encryptionkey@0"
I20260809 00:49:18.092124 20879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:18.143669 20879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:18.148131 20879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:18.148388 20879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:18.166832 20879 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:41567
I20260809 00:49:18.166852 20980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:41567 every 8 connection(s)
I20260809 00:49:18.168277 20879 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:18.168823 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 20879
I20260809 00:49:18.169791 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:33621
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:41567
--webserver_port=41265
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:49:18.175293 20981 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:49:18.178582 20981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap starting.
I20260809 00:49:18.202498 20981 log.cc:824] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:18.218963 20981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:49:18.219485 20981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05: Bootstrap complete.
I20260809 00:49:18.228653 20981 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:18.229552 20981 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b45b374ed744bcba937b70913a7ce05, State: Initialized, Role: FOLLOWER
I20260809 00:49:18.230208 20981 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:18.230446 20981 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:49:18.230564 20981 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:49:18.230729 20981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 2 FOLLOWER]: Advancing to term 3
I20260809 00:49:18.234680 20981 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:18.235162 20981 leader_election.cc:302] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b45b374ed744bcba937b70913a7ce05; no voters:
I20260809 00:49:18.235826 20981 leader_election.cc:288] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 00:49:18.235965 20985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 00:49:18.237103 20985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [term 3 LEADER]: Becoming Leader. State: Replica: 0b45b374ed744bcba937b70913a7ce05, State: Running, Role: LEADER
I20260809 00:49:18.237684 20985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } }
I20260809 00:49:18.238049 20981 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:18.240170 20990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b45b374ed744bcba937b70913a7ce05. Latest consensus state: current_term: 3 leader_uuid: "0b45b374ed744bcba937b70913a7ce05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } } }
I20260809 00:49:18.240564 20990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:18.241101 20987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "0b45b374ed744bcba937b70913a7ce05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b45b374ed744bcba937b70913a7ce05" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41567 } } }
I20260809 00:49:18.241420 20987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b45b374ed744bcba937b70913a7ce05 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:18.247123 20996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:18.256523 20996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:18.258024 20996 catalog_manager.cc:1259] Loaded cluster ID: 48526bd574534ec191135816d344422d
I20260809 00:49:18.258127 20996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 00:49:18.260586 20996 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0a350ba9ad google::LogMessage::Fail() at ??:0
@ 0x7f0a350bd88a google::LogMessage::SendToLog() at ??:0
@ 0x7f0a350ba4de google::LogMessage::Flush() at ??:0
@ 0x7f0a350bba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f0a4aaed512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f0a4aaea976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0a4ab72610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f0a4ab72439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0a37d06345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f0a37d0991c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f0a37d09799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0a37ce4eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0a3afbe6db start_thread at ??:0
@ 0x7f0a33f5461f clone at ??:0
W20260809 00:49:18.564939 20983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:18.565236 20983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:18.565372 20983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:18.572755 20983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:18.572875 20983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:18.573024 20983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:49:18.582892 20983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:33621
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=41265
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:18.584185 20983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:18.585518 20983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:18.598272 21040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:18.598359 21047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:18.598312 21044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:18.599323 20983 server_base.cc:1034] running on GCE node
I20260809 00:49:18.599961 20983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:18.600924 20983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:18.602130 20983 hybrid_clock.cc:648] HybridClock initialized: now 1786236558602074 us; error 51 us; skew 500 ppm
I20260809 00:49:18.602463 20983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:18 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236558, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:18.605587 20983 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:49:18.607120 20983 webserver.cc:460] Webserver started at http://127.28.92.129:41265/ using document root <none> and password file <none>
I20260809 00:49:18.607805 20983 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:18.607944 20983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:18.613379 20983 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:49:18.619051 21057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:18.620476 20983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 00:49:18.620651 20983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "557402c23feb4dca911bc3ed97393cdc"
format_stamp: "Formatted at 2026-08-09 00:49:12 on dist-test-slave-t7g5"
server_key: "794e7c4bd6653030cbcaf5a3a1281fcf"
server_key_iv: "ad966330d806e5f10f7aeef5ac1c6e0f"
server_key_version: "encryptionkey@0"
I20260809 00:49:18.621745 20983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:18.635496 20983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:18.639422 20983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:18.639686 20983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:18.640703 20983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:18.642640 21066 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 00:49:18.648168 20983 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 00:49:18.648294 20983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.001s
I20260809 00:49:18.648420 20983 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 00:49:18.651629 20983 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 00:49:18.651712 20983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.001s
I20260809 00:49:18.652046 21066 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Bootstrap starting.
I20260809 00:49:18.679960 21066 log.cc:824] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:18.688309 20983 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:33621
I20260809 00:49:18.688313 21217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:33621 every 8 connection(s)
I20260809 00:49:18.689966 20983 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:49:18.694906 21066 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:49:18.695250 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:18.693101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:46283)
0809 00:49:18.694058 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:18.694322 (+ 264us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":482,"threads_started":1}
I20260809 00:49:18.695497 21066 tablet_bootstrap.cc:492] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Bootstrap complete.
W20260809 00:49:18.695972 21220 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:41567 (0 consecutive failures): Network error: Failed to ping master at 127.28.92.190:41567: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
I20260809 00:49:18.696861 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:18.696503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:44485)
0809 00:49:18.696663 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:18.696739 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 00:49:18.696929 21066 ts_tablet_manager.cc:1397] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Time spent bootstrapping tablet: real 0.045s user 0.032s sys 0.009s
I20260809 00:49:18.697857 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:18.697459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:52113)
0809 00:49:18.697604 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:18.697717 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 00:49:18.698127 21220 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 00:49:18.700027 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 20983
I20260809 00:49:18.700687 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:35921
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:41567
--webserver_port=34067
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:49:18.703683 21066 raft_consensus.cc:348] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:18.704618 21066 raft_consensus.cc:729] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557402c23feb4dca911bc3ed97393cdc, State: Initialized, Role: FOLLOWER
I20260809 00:49:18.705297 21066 consensus_queue.cc:260] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:18.706934 21066 ts_tablet_manager.cc:1428] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc: Time spent starting tablet: real 0.010s user 0.008s sys 0.004s
I20260809 00:49:18.707274 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:18.706818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:44443)
0809 00:49:18.707010 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:18.707111 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 00:49:18.708180 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:18.707876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:35375)
0809 00:49:18.707996 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:18.708063 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 00:49:19.041463 21225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:19.041826 21225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:19.041975 21225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:19.049332 21225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:19.049479 21225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:19.049670 21225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:49:19.059829 21225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:35921
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=34067
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:19.061223 21225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:19.062649 21225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:19.075971 21231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:19.076056 21235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:19.075997 21232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:19.077003 21225 server_base.cc:1034] running on GCE node
I20260809 00:49:19.077641 21225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:19.078694 21225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:19.079879 21225 hybrid_clock.cc:648] HybridClock initialized: now 1786236559079819 us; error 58 us; skew 500 ppm
I20260809 00:49:19.080200 21225 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:19 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236559, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:19.083417 21225 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:49:19.084918 21225 webserver.cc:460] Webserver started at http://127.28.92.130:34067/ using document root <none> and password file <none>
I20260809 00:49:19.085621 21225 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:19.085778 21225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:19.091117 21225 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 00:49:19.093873 21244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:19.095188 21225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:49:19.095351 21225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "a755cf7931dd45d6ac698c1b16d69752"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "d7e28cd2a614c6093437cdfe845c8925"
server_key_iv: "84ef9f895ff7649fc1308808089101f8"
server_key_version: "encryptionkey@0"
I20260809 00:49:19.096375 21225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:19.114789 21225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:19.119190 21225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:19.119467 21225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:19.120455 21225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:19.121857 21225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:19.121953 21225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:19.122068 21225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:19.122144 21225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:19.150739 21225 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:35921
I20260809 00:49:19.150799 21410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:35921 every 8 connection(s)
I20260809 00:49:19.152227 21225 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:49:19.156991 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.155196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:60583)
0809 00:49:19.155928 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.156155 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":283,"threads_started":1}
W20260809 00:49:19.157608 21412 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:41567 (0 consecutive failures): Network error: Failed to ping master at 127.28.92.190:41567: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
I20260809 00:49:19.158469 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.158087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:48227)
0809 00:49:19.158232 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.158331 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 00:49:19.158744 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 21225
I20260809 00:49:19.159394 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.159005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:41561)
0809 00:49:19.159153 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.159248 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 00:49:19.159504 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:41179
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:41567
--webserver_port=43331
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:19.159677 21412 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 00:49:19.487576 21416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:19.487841 21416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:19.487982 21416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:19.495014 21416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:19.495128 21416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:19.495280 21416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:49:19.505070 21416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:41179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=43331
--tserver_master_addrs=127.28.92.190:41567
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:19.506388 21416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:19.507723 21416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:19.520761 21426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:19.520825 21424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:19.520889 21428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:19.521464 21416 server_base.cc:1034] running on GCE node
I20260809 00:49:19.522123 21416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:19.523053 21416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:19.524333 21416 hybrid_clock.cc:648] HybridClock initialized: now 1786236559524279 us; error 36 us; skew 500 ppm
I20260809 00:49:19.524678 21416 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:19 dist-test-slave-t7g5 krb5kdc[19289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236559, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:19.527869 21416 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:49:19.529278 21416 webserver.cc:460] Webserver started at http://127.28.92.131:43331/ using document root <none> and password file <none>
I20260809 00:49:19.530040 21416 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:19.530148 21416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:19.535494 21416 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:49:19.538137 21437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:19.539407 21416 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:49:19.539546 21416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "4163ca7627424e96b00508df94acfd9e"
format_stamp: "Formatted at 2026-08-09 00:49:13 on dist-test-slave-t7g5"
server_key: "72052885ee78d93e5b00d440a88ed001"
server_key_iv: "8529096b9a03e2327b2e466f3cab5e3d"
server_key_version: "encryptionkey@0"
I20260809 00:49:19.540473 21416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:19.564944 21416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:19.568727 21416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:19.568977 21416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:19.569947 21416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:19.571339 21416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:19.571429 21416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:19.571508 21416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:19.571561 21416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:19.601613 21416 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41179
I20260809 00:49:19.601701 21621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41179 every 8 connection(s)
I20260809 00:49:19.603088 21416 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:49:19.605304 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 21416
I20260809 00:49:19.608210 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.606153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:49131)
0809 00:49:19.606956 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.607399 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":318,"threads_started":1}
W20260809 00:49:19.608875 21622 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:41567 (0 consecutive failures): Network error: Failed to ping master at 127.28.92.190:41567: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
I20260809 00:49:19.609628 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.609309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:42791)
0809 00:49:19.609454 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.609525 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 00:49:19.610445 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.610156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:58819)
0809 00:49:19.610261 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.610341 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 00:49:19.610656 21622 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 00:49:19.709889 21629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:19.709043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:41243)
0809 00:49:19.709523 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:19.709645 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":228,"threads_started":1}
I20260809 00:49:20.161170 21630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.160302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:49837)
0809 00:49:20.160794 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:20.160936 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":222,"threads_started":1}
I20260809 00:49:20.520287 21632 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:20.520574 21632 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:20.522275 21632 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
Aug 09 00:49:20 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236558, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
Aug 09 00:49:20 dist-test-slave-t7g5 krb5kdc[19289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236558, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:49:20.552098 21635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.522794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:41319 (local address 127.28.92.131:41179)
0809 00:49:20.524844 (+ 2050us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:20.524860 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:20.524892 (+ 32us) server_negotiation.cc:407] Connection header received
0809 00:49:20.526606 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:20.526618 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:20.527043 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:20.527338 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:20.529441 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.530832 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.532562 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.533177 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.533352 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:20.545240 (+ 11888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:20.545249 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:20.545272 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:20.545315 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:20.548229 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:20.549070 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:20.549077 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:20.549082 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:20.549266 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:20.549742 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:20.549747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:20.549750 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:20.550291 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:20.550461 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:20.551277 (+ 816us) server_negotiation.cc:299] Negotiation successful
0809 00:49:20.551699 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1865,"thread_start_us":1774,"threads_started":1}
I20260809 00:49:20.552099 21637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.523778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:53467 (local address 127.28.92.130:35921)
0809 00:49:20.525233 (+ 1455us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:20.525247 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:20.525284 (+ 37us) server_negotiation.cc:407] Connection header received
0809 00:49:20.526903 (+ 1619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:20.526912 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:20.527224 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:20.527520 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:20.529422 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.530821 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.532564 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.533177 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.533345 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:20.545180 (+ 11835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:20.545191 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:20.545208 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:20.545257 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:20.548144 (+ 2887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:20.549075 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:20.549082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:20.549088 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:20.549257 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:20.549748 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:20.549754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:20.549757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:20.550278 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:20.550454 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:20.551285 (+ 831us) server_negotiation.cc:299] Negotiation successful
0809 00:49:20.551716 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1303,"thread_start_us":1127,"threads_started":1}
I20260809 00:49:20.552521 21636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.523389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:35921 (local address 127.28.92.129:53467)
0809 00:49:20.524626 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:20.524644 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:20.524750 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:20.527514 (+ 2764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:20.527523 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:20.528446 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:20.529209 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:20.529229 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.531012 (+ 1783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.531016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:20.532426 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:20.532439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.533380 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.533387 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:20.533728 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:20.542069 (+ 8341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:20.542120 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:20.544772 (+ 2652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:20.548318 (+ 3546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:20.548328 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:20.548345 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:20.548929 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:20.549382 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:20.549387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:20.549391 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:20.549615 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:20.550425 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:20.550433 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:20.550769 (+ 336us) client_negotiation.cc:769] Sending connection context
0809 00:49:20.551031 (+ 262us) client_negotiation.cc:240] Negotiation successful
0809 00:49:20.551596 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1116,"mutex_wait_us":154,"spinlock_wait_cycles":72320,"thread_start_us":911,"threads_started":1}
I20260809 00:49:20.552982 21633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.522550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41179 (local address 127.28.92.129:41319)
0809 00:49:20.523166 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:20.523216 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:20.523829 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:20.527511 (+ 3682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:20.527523 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:20.528446 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:20.529214 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:20.529231 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.531012 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.531016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:20.532427 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:20.532440 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:20.533426 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:20.533435 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:20.533731 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:20.542073 (+ 8342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:20.542116 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:20.544970 (+ 2854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:20.548391 (+ 3421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:20.548394 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:20.548397 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:20.548928 (+ 531us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:20.549389 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:20.549394 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:20.549397 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:20.549615 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:20.550429 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:20.550434 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:20.550767 (+ 333us) client_negotiation.cc:769] Sending connection context
0809 00:49:20.551033 (+ 266us) client_negotiation.cc:240] Negotiation successful
0809 00:49:20.552488 (+ 1455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":977,"spinlock_wait_cycles":35968,"thread_start_us":288,"threads_started":1}
W20260809 00:49:20.555920 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
W20260809 00:49:20.556649 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:20.556785 21060 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc; no voters: 4163ca7627424e96b00508df94acfd9e, a755cf7931dd45d6ac698c1b16d69752
I20260809 00:49:20.557138 21632 raft_consensus.cc:2726] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 00:49:20.612058 21639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.611178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:42553)
0809 00:49:20.611652 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:20.611810 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":228,"threads_started":1}
I20260809 00:49:20.711295 21633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:20.710820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:40603)
0809 00:49:20.711028 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:20.711143 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 00:49:21.162870 21641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:21.162146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:38419)
0809 00:49:21.162603 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:21.162693 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":233,"threads_started":1}
I20260809 00:49:21.613543 21644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:21.612848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:59655)
0809 00:49:21.613297 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:21.613380 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":220,"threads_started":1}
I20260809 00:49:21.712986 21647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:21.712147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:44781)
0809 00:49:21.712694 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:21.712786 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":233,"threads_started":1}
I20260809 00:49:22.164638 21648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:22.163831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:42695)
0809 00:49:22.164367 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:22.164458 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":280,"threads_started":1}
I20260809 00:49:22.596865 21649 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:22.597059 21649 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:22.597769 21649 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
W20260809 00:49:22.598768 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
W20260809 00:49:22.599025 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:22.599116 21060 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc; no voters: 4163ca7627424e96b00508df94acfd9e, a755cf7931dd45d6ac698c1b16d69752
I20260809 00:49:22.599368 21649 raft_consensus.cc:2726] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 00:49:22.615121 21650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:22.614406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:52817)
0809 00:49:22.614846 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:22.614955 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":223,"threads_started":1}
I20260809 00:49:22.714633 21651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:22.713850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:38705)
0809 00:49:22.714315 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:22.714434 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":217,"threads_started":1}
I20260809 00:49:23.166323 21652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:23.165594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:42453)
0809 00:49:23.166052 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:23.166133 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":256,"threads_started":1}
I20260809 00:49:23.616760 21654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:23.616055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:46901)
0809 00:49:23.616496 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:23.616579 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":213,"threads_started":1}
I20260809 00:49:23.716696 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:23.715857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:43105)
0809 00:49:23.716409 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:23.716503 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":276,"threads_started":1}
I20260809 00:49:24.170250 21659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:24.167390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:40589)
0809 00:49:24.169973 (+ 2583us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:24.170068 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2451,"thread_start_us":2340,"threads_started":1}
I20260809 00:49:24.618424 21660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:24.617687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:48977)
0809 00:49:24.618157 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:24.618241 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":253,"threads_started":1}
I20260809 00:49:24.718341 21661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:24.717585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:51611)
0809 00:49:24.718080 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:24.718164 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":290,"threads_started":1}
I20260809 00:49:25.172010 21662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:25.171222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:39235)
0809 00:49:25.171706 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:25.171806 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":251,"threads_started":1}
I20260809 00:49:25.266625 21663 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:25.266853 21663 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:25.267525 21663 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
W20260809 00:49:25.268630 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
W20260809 00:49:25.268913 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:25.269045 21060 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc; no voters: 4163ca7627424e96b00508df94acfd9e, a755cf7931dd45d6ac698c1b16d69752
I20260809 00:49:25.269322 21663 raft_consensus.cc:2726] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 00:49:25.620059 21664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:25.619315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:57623)
0809 00:49:25.619793 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:25.619882 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":259,"threads_started":1}
I20260809 00:49:25.720041 21665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:25.719237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:39757)
0809 00:49:25.719709 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:25.719831 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":245,"threads_started":1}
I20260809 00:49:26.173854 21666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:26.172946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:44065)
0809 00:49:26.173526 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:26.173616 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":268,"threads_started":1}
I20260809 00:49:26.621767 21668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:26.620979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:54321)
0809 00:49:26.621467 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:26.621549 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":216,"threads_started":1}
I20260809 00:49:26.721637 21672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:26.720914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:46413)
0809 00:49:26.721360 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:26.721459 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":228,"threads_started":1}
I20260809 00:49:27.175444 21673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:27.174767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:58065)
0809 00:49:27.175190 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:27.175273 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":219,"threads_started":1}
I20260809 00:49:27.470364 21674 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:27.470564 21674 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:27.471153 21674 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
W20260809 00:49:27.472007 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
W20260809 00:49:27.472200 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:27.472275 21060 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc; no voters: 4163ca7627424e96b00508df94acfd9e, a755cf7931dd45d6ac698c1b16d69752
I20260809 00:49:27.472501 21674 raft_consensus.cc:2726] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 00:49:27.623207 21676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:27.622553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:41525)
0809 00:49:27.622949 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:27.623028 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":194,"threads_started":1}
I20260809 00:49:27.723423 21677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:27.722591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:46565)
0809 00:49:27.723098 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:27.723205 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":246,"threads_started":1}
I20260809 00:49:28.177069 21678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:28.176307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:60213)
0809 00:49:28.176811 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:28.176906 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":241,"threads_started":1}
I20260809 00:49:28.624828 21680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:28.624062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:53617)
0809 00:49:28.624556 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:28.624653 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":220,"threads_started":1}
I20260809 00:49:28.725124 21683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:28.724403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:52835)
0809 00:49:28.724858 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:28.724942 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":222,"threads_started":1}
I20260809 00:49:29.178630 21686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:29.177949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:35849)
0809 00:49:29.178372 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:29.178453 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":217,"threads_started":1}
I20260809 00:49:29.626415 21689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:29.625712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:53319)
0809 00:49:29.626150 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:29.626230 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":242,"threads_started":1}
I20260809 00:49:29.726678 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:29.725972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:60121)
0809 00:49:29.726415 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:29.726495 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":232,"threads_started":1}
I20260809 00:49:30.180222 21692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:30.179489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:38961)
0809 00:49:30.179968 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:30.180052 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":228,"threads_started":1}
I20260809 00:49:30.627887 21693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:30.627189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:33819)
0809 00:49:30.627639 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:30.627723 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":210,"threads_started":1}
I20260809 00:49:30.728346 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:30.727456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:33021)
0809 00:49:30.727960 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:30.728072 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":255,"threads_started":1}
I20260809 00:49:31.181883 21698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:31.181118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:36943)
0809 00:49:31.181569 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:31.181679 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":238,"threads_started":1}
I20260809 00:49:31.629540 21700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:31.628765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:54771)
0809 00:49:31.629263 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:31.629362 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":257,"threads_started":1}
I20260809 00:49:31.730155 21701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:31.729311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:53063)
0809 00:49:31.729883 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:31.729966 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":249,"threads_started":1}
I20260809 00:49:32.183607 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:32.182871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:34185)
0809 00:49:32.183353 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:32.183446 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":251,"threads_started":1}
I20260809 00:49:32.631162 21703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:32.630465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:42521)
0809 00:49:32.630907 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:32.630997 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":220,"threads_started":1}
I20260809 00:49:32.731751 21704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:32.731021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:52551)
0809 00:49:32.731469 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:32.731553 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":227,"threads_started":1}
I20260809 00:49:33.185168 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:33.184418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:53277)
0809 00:49:33.184893 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:33.184973 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":232,"threads_started":1}
I20260809 00:49:33.240053 21707 raft_consensus.cc:482] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:33.240257 21707 raft_consensus.cc:504] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4163ca7627424e96b00508df94acfd9e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41179 } } peers { permanent_uuid: "557402c23feb4dca911bc3ed97393cdc" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33621 } } peers { permanent_uuid: "a755cf7931dd45d6ac698c1b16d69752" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 35921 } }
I20260809 00:49:33.240906 21707 leader_election.cc:288] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179), a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921)
W20260809 00:49:33.241966 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a755cf7931dd45d6ac698c1b16d69752 (127.28.92.130:35921): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
W20260809 00:49:33.242152 21060 leader_election.cc:341] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4163ca7627424e96b00508df94acfd9e (127.28.92.131:41179): Not found: Tablet not found: 3a09db2d6a494eac9f6c5ece595483cc
I20260809 00:49:33.242254 21060 leader_election.cc:302] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 557402c23feb4dca911bc3ed97393cdc; no voters: 4163ca7627424e96b00508df94acfd9e, a755cf7931dd45d6ac698c1b16d69752
I20260809 00:49:33.242486 21707 raft_consensus.cc:2726] T 3a09db2d6a494eac9f6c5ece595483cc P 557402c23feb4dca911bc3ed97393cdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 00:49:33.632694 21710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:33.631972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:51245)
0809 00:49:33.632407 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:33.632497 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":216,"threads_started":1}
I20260809 00:49:33.733803 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:33.732897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.129:42683)
0809 00:49:33.733428 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:33.733565 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":270,"threads_started":1}
I20260809 00:49:34.187112 21712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:34.186344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.130:41721)
0809 00:49:34.186823 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:34.186944 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":214,"threads_started":1}
I20260809 00:49:34.611197 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 20983
I20260809 00:49:34.626758 21714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:34.612191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49764 (local address 127.28.92.129:33621)
0809 00:49:34.612724 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:34.612734 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:34.613140 (+ 406us) server_negotiation.cc:407] Connection header received
0809 00:49:34.613447 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:34.613460 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:34.613760 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:34.613959 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:34.615683 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:34.616681 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:34.617969 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:34.618537 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:34.618633 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:34.621147 (+ 2514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:34.621160 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:34.621176 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:34.621209 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:34.624081 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:34.624734 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:34.624744 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:34.624747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:34.624927 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:34.625251 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:34.625254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:34.625256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:34.625748 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:34.626043 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:34.626250 (+ 207us) server_negotiation.cc:299] Negotiation successful
0809 00:49:34.626478 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":244,"threads_started":1}
I20260809 00:49:34.628012 21211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:34.634598 21717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:34.633868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:41567 (local address 127.28.92.131:59579)
0809 00:49:34.634335 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:34.634445 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:41567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":232,"threads_started":1}
I20260809 00:49:34.716369 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 20983
I20260809 00:49:34.741231 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 21225
I20260809 00:49:34.753947 21718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:34.742022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35326 (local address 127.28.92.130:35921)
0809 00:49:34.742510 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:34.742514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:34.742532 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:49:34.742587 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:34.742591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:34.742649 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:34.742739 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:34.744055 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:34.744930 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:34.746169 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:34.746604 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:34.746698 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:34.749202 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:34.749207 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:34.749210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:34.749241 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:34.751755 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:34.752339 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:34.752343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:34.752345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:34.752469 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:34.752733 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:34.752736 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:34.752738 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:34.753006 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:34.753205 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:34.753399 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 00:49:34.753564 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":256,"threads_started":1}
I20260809 00:49:34.754659 21401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:34.836254 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 21225
I20260809 00:49:34.864512 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 21416
I20260809 00:49:34.878087 21721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:34.865493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36998 (local address 127.28.92.131:41179)
0809 00:49:34.866065 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:34.866070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:34.866087 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:49:34.866143 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:34.866146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:34.866214 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:34.866306 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:34.867850 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:34.868703 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:34.870072 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:34.870527 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:34.870637 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:34.873177 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:34.873184 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:34.873187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:34.873221 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:34.875783 (+ 2562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:34.876422 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:34.876425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:34.876428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:34.876564 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:34.876850 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:34.876853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:34.876855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:34.877103 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:34.877308 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:34.877517 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 00:49:34.877730 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":305,"threads_started":1}
I20260809 00:49:34.878796 21610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:34.962282 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 21416
2026-08-09T00:49:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24494 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:49:35 dist-test-slave-t7g5 krb5kdc[21728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:49:35 dist-test-slave-t7g5 krb5kdc[21728](info): set up 2 sockets
Aug 09 00:49:35 dist-test-slave-t7g5 krb5kdc[21728](info): commencing operation
krb5kdc: starting...
W20260809 00:49:36.206044 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:49:36 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:49:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:49:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:49:36.463402 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:37741
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:37741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:36.793807 21746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:36.794099 21746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:36.794202 21746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:36.801318 21746 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 00:49:36.801426 21746 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 00:49:36.801465 21746 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 00:49:36.801518 21746 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:36.801573 21746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:36.801640 21746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:36.801724 21746 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:36.801800 21746 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:36.811821 21746 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:37741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:37741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:36.813010 21746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:36.814337 21746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:36.825717 21753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:36.825645 21754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:36.825748 21756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:36.826586 21746 server_base.cc:1034] running on GCE node
I20260809 00:49:36.827333 21746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:36.828575 21746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:36.829763 21746 hybrid_clock.cc:648] HybridClock initialized: now 1786236576829698 us; error 33 us; skew 500 ppm
I20260809 00:49:36.830080 21746 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:36 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236576, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:36.833104 21746 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:36.834507 21746 webserver.cc:460] Webserver started at http://127.28.92.190:34887/ using document root <none> and password file <none>
I20260809 00:49:36.835156 21746 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:36.835258 21746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:36.835589 21746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:36.838446 21746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "7fb0f480c22d4e7f9e3d6229857175f2"
format_stamp: "Formatted at 2026-08-09 00:49:36 on dist-test-slave-t7g5"
server_key: "18597ea8c9aed6d31014078939d5b652"
server_key_iv: "bd370b44cdf1c8e87c34602e51934490"
server_key_version: "encryptionkey@0"
I20260809 00:49:36.839185 21746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "7fb0f480c22d4e7f9e3d6229857175f2"
format_stamp: "Formatted at 2026-08-09 00:49:36 on dist-test-slave-t7g5"
server_key: "18597ea8c9aed6d31014078939d5b652"
server_key_iv: "bd370b44cdf1c8e87c34602e51934490"
server_key_version: "encryptionkey@0"
I20260809 00:49:36.843930 21746 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 00:49:36.847252 21768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:36.848513 21746 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260809 00:49:36.848683 21746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "7fb0f480c22d4e7f9e3d6229857175f2"
format_stamp: "Formatted at 2026-08-09 00:49:36 on dist-test-slave-t7g5"
server_key: "18597ea8c9aed6d31014078939d5b652"
server_key_iv: "bd370b44cdf1c8e87c34602e51934490"
server_key_version: "encryptionkey@0"
I20260809 00:49:36.848888 21746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:36.872741 21746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:36.876863 21746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:36.877127 21746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:36.895407 21746 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:37741
I20260809 00:49:36.895419 21839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:37741 every 8 connection(s)
I20260809 00:49:36.896763 21746 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:36.897253 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 21746
I20260809 00:49:36.897470 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:49:36.898283 29042 external_mini_cluster.cc:1428] Setting key 32735482e384fcf93a3e2da313ff9c78
I20260809 00:49:36.901897 21840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 00:49:36 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:36.913982 21840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap starting.
I20260809 00:49:36.918057 21840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:36.919221 21840 log.cc:824] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:36.922574 21840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: No bootstrap required, opened a new log
I20260809 00:49:36.922686 21846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:36.900067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55326 (local address 127.28.92.190:37741)
0809 00:49:36.900864 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:36.900878 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:36.900929 (+ 51us) server_negotiation.cc:407] Connection header received
0809 00:49:36.903250 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:36.903278 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:36.903760 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:36.904177 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:36.905760 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:36.907783 (+ 2023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:36.909098 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:36.910149 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:36.910322 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:36.914237 (+ 3915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:36.914248 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:36.914266 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:36.914313 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:36.918146 (+ 3833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:36.918897 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:36.918906 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:36.918914 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:36.919151 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:36.919517 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:36.919522 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:36.919524 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:36.920187 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:36.920438 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:36.920961 (+ 523us) server_negotiation.cc:299] Negotiation successful
0809 00:49:36.921376 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":326,"threads_started":1}
I20260809 00:49:36.929953 21840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:36.930277 21840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:36.930361 21840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fb0f480c22d4e7f9e3d6229857175f2, State: Initialized, Role: FOLLOWER
I20260809 00:49:36.930832 21840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:36.931030 21840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:49:36.931126 21840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:49:36.931245 21840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:36.933367 21840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:36.933856 21840 leader_election.cc:302] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fb0f480c22d4e7f9e3d6229857175f2; no voters:
I20260809 00:49:36.934393 21840 leader_election.cc:288] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:49:36.934508 21850 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:36.935129 21850 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 LEADER]: Becoming Leader. State: Replica: 7fb0f480c22d4e7f9e3d6229857175f2, State: Running, Role: LEADER
I20260809 00:49:36.935645 21850 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:36.936252 21840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:36.938364 21854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fb0f480c22d4e7f9e3d6229857175f2. Latest consensus state: current_term: 1 leader_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } } }
I20260809 00:49:36.938485 21852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } } }
I20260809 00:49:36.938781 21854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:36.938851 21852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:36.941268 21862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:36.945537 21862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:36.953343 21862 catalog_manager.cc:1347] Generated new cluster ID: d95df49822164210847a6bb7c1db7eec
I20260809 00:49:36.953493 21862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:49:36.975250 21862 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:49:36.976550 21862 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:49:36.982730 21862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Generated new TSK 0
I20260809 00:49:36.983531 21862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:49:37.050786 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:37741
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:37.377115 21880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:37.377372 21880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:37.377494 21880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:37.384398 21880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:37.384490 21880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:37.384629 21880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:49:37.393792 21880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:37.394995 21880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:37.396250 21880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:37.408432 21894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:37.408505 21887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:37.408529 21891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:37.409241 21880 server_base.cc:1034] running on GCE node
I20260809 00:49:37.409878 21880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:37.410771 21880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:37.411953 21880 hybrid_clock.cc:648] HybridClock initialized: now 1786236577411904 us; error 39 us; skew 500 ppm
I20260809 00:49:37.412217 21880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:37 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236577, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:37.415200 21880 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:49:37.416550 21880 webserver.cc:460] Webserver started at http://127.28.92.129:38529/ using document root <none> and password file <none>
I20260809 00:49:37.417184 21880 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:37.417310 21880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:37.417596 21880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:37.420395 21880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "815136bb87da4ba785ef019df6145f13"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0454dab0a0cc039a63f75ca534c7168d"
server_key_iv: "67fba25c379edf69d5a5e86192644cf4"
server_key_version: "encryptionkey@0"
I20260809 00:49:37.421190 21880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "815136bb87da4ba785ef019df6145f13"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0454dab0a0cc039a63f75ca534c7168d"
server_key_iv: "67fba25c379edf69d5a5e86192644cf4"
server_key_version: "encryptionkey@0"
I20260809 00:49:37.426043 21880 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:49:37.429351 21906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:37.430675 21880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:49:37.430835 21880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "815136bb87da4ba785ef019df6145f13"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0454dab0a0cc039a63f75ca534c7168d"
server_key_iv: "67fba25c379edf69d5a5e86192644cf4"
server_key_version: "encryptionkey@0"
I20260809 00:49:37.431033 21880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:37.462939 21880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:37.467020 21880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:37.467300 21880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:37.468287 21880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:37.469595 21880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:37.469705 21880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:37.469837 21880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:37.469899 21880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:37.500442 21880 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40681
I20260809 00:49:37.500528 22070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40681 every 8 connection(s)
I20260809 00:49:37.501698 21880 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:49:37.508987 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 21880
I20260809 00:49:37.509234 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:49:37.509925 29042 external_mini_cluster.cc:1428] Setting key 2e7ef09a8ae629b049dd768f1eed3ca7
Aug 09 00:49:37 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236577, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:37.522451 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:37.504252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:59317 (local address 127.28.92.190:37741)
0809 00:49:37.504693 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:37.504697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:37.505561 (+ 864us) server_negotiation.cc:407] Connection header received
0809 00:49:37.507425 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:37.507431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:37.507510 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:37.507607 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:37.509374 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:37.510184 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:37.511802 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:37.512341 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:37.512492 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:37.516120 (+ 3628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:37.516127 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:37.516131 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:37.516169 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:37.519195 (+ 3026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:37.519985 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:37.519990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:37.519993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:37.520144 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:37.520625 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:37.520629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:37.520632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:37.520979 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:37.521125 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:37.521885 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 00:49:37.522106 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":236,"threads_started":1}
I20260809 00:49:37.523463 22077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:37.504725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:59317)
0809 00:49:37.505399 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:37.505441 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:37.507156 (+ 1715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:37.507861 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:37.507869 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:37.508381 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:37.509150 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:37.509178 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:37.510400 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:37.510405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:37.511653 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:37.511666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:37.512591 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:37.512597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:37.512818 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:37.513505 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:37.513536 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:37.515884 (+ 2348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:37.519355 (+ 3471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:37.519362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:37.519375 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:37.519845 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:37.520283 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:37.520287 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:37.520289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:37.520517 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:37.521115 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:37.521121 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:37.521475 (+ 354us) client_negotiation.cc:769] Sending connection context
0809 00:49:37.521781 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 00:49:37.522197 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":271,"threads_started":1}
I20260809 00:49:37.525099 22074 heartbeater.cc:347] Connected to a master server at 127.28.92.190:37741
I20260809 00:49:37.525398 22074 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:37.526146 22074 heartbeater.cc:511] Master 127.28.92.190:37741 requested a full tablet report, sending...
I20260809 00:49:37.528201 21791 ts_manager.cc:194] Registered new tserver with Master: 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681)
I20260809 00:49:37.529683 21791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:59317
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:49:37.570039 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:37741
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:37.893725 22082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:37.894018 22082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:37.894157 22082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:37.901351 22082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:37.901472 22082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:37.901630 22082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:49:37.911232 22082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:37.912451 22082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:37.913781 22082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:37.926331 22090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:37.926366 22095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:37.926671 22092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:37.927158 22082 server_base.cc:1034] running on GCE node
I20260809 00:49:37.927767 22082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:37.928664 22082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:37.929855 22082 hybrid_clock.cc:648] HybridClock initialized: now 1786236577929809 us; error 50 us; skew 500 ppm
I20260809 00:49:37.930140 22082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:37 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236577, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:37.933068 22082 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:49:37.934525 22082 webserver.cc:460] Webserver started at http://127.28.92.130:42299/ using document root <none> and password file <none>
I20260809 00:49:37.935184 22082 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:37.935293 22082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:37.935609 22082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:37.938514 22082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "6784206d0a6545c19de49c79a87f0479"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0af381d4fc2909cbac925effd4e13f41"
server_key_iv: "53179734b5e99716725cd60b6d21ccbe"
server_key_version: "encryptionkey@0"
I20260809 00:49:37.939239 22082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "6784206d0a6545c19de49c79a87f0479"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0af381d4fc2909cbac925effd4e13f41"
server_key_iv: "53179734b5e99716725cd60b6d21ccbe"
server_key_version: "encryptionkey@0"
I20260809 00:49:37.944095 22082 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:49:37.947540 22107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:37.948798 22082 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:49:37.948964 22082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "6784206d0a6545c19de49c79a87f0479"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0af381d4fc2909cbac925effd4e13f41"
server_key_iv: "53179734b5e99716725cd60b6d21ccbe"
server_key_version: "encryptionkey@0"
I20260809 00:49:37.949186 22082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:37.964932 22082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:37.969048 22082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:37.969344 22082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:37.970388 22082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:37.971828 22082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:37.971912 22082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:37.972046 22082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:37.972105 22082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:38.005443 22082 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:40617
I20260809 00:49:38.005475 22261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:40617 every 8 connection(s)
I20260809 00:49:38.006870 22082 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:49:38.015666 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 22082
I20260809 00:49:38.015859 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:49:38.016338 29042 external_mini_cluster.cc:1428] Setting key 20d9abfed60323e186b874d5fecb156b
Aug 09 00:49:38 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236577, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:38.028324 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.009411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:44155 (local address 127.28.92.190:37741)
0809 00:49:38.009571 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.009575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.010884 (+ 1309us) server_negotiation.cc:407] Connection header received
0809 00:49:38.012719 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.012732 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.012819 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.012925 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:38.014523 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.015323 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.017079 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.017720 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.017943 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.021740 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:38.021747 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:38.021752 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:38.021796 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:38.025079 (+ 3283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.025851 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.025857 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.025861 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.026037 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.026462 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.026467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.026470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.026845 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:38.027004 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.027675 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.027913 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":52}
I20260809 00:49:38.029045 22267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.009943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:44155)
0809 00:49:38.010687 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.010737 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.012435 (+ 1698us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.013172 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.013181 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.013751 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:38.014332 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.014355 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.015521 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.015525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.016912 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.016930 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.018068 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.018079 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.018433 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.019061 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:38.019084 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:38.021449 (+ 2365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:38.025226 (+ 3777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:38.025233 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:38.025247 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:38.025728 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:38.026142 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:38.026145 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:38.026147 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:38.026346 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:38.026956 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:38.026961 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:38.027283 (+ 322us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.027515 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.027923 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":295,"threads_started":1}
I20260809 00:49:38.030519 22262 heartbeater.cc:347] Connected to a master server at 127.28.92.190:37741
I20260809 00:49:38.030815 22262 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:38.031554 22262 heartbeater.cc:511] Master 127.28.92.190:37741 requested a full tablet report, sending...
I20260809 00:49:38.033095 21791 ts_manager.cc:194] Registered new tserver with Master: 6784206d0a6545c19de49c79a87f0479 (127.28.92.130:40617)
I20260809 00:49:38.033942 21791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:44155
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:49:38.078645 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:37741
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:38.409518 22270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:38.409849 22270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:38.409973 22270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:38.417088 22270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:38.417212 22270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:38.417379 22270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:49:38.427332 22270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:38.428640 22270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:38.429992 22270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:38.443830 22277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:38.443890 22279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:38.444069 22281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:38.444726 22270 server_base.cc:1034] running on GCE node
I20260809 00:49:38.445344 22270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:38.446379 22270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:38.447585 22270 hybrid_clock.cc:648] HybridClock initialized: now 1786236578447535 us; error 36 us; skew 500 ppm
I20260809 00:49:38.447906 22270 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:38 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236578, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:38.450996 22270 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:49:38.452421 22270 webserver.cc:460] Webserver started at http://127.28.92.131:38061/ using document root <none> and password file <none>
I20260809 00:49:38.453135 22270 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:38.453240 22270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:38.453505 22270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:49:38.456435 22270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "42368dc7ec3e48ca823997a82ab9da5e"
format_stamp: "Formatted at 2026-08-09 00:49:38 on dist-test-slave-t7g5"
server_key: "26913d71f411ea80119806bc03983d5a"
server_key_iv: "a65f56e49a767cd8be04116f1ff946b0"
server_key_version: "encryptionkey@0"
I20260809 00:49:38.457124 22270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "42368dc7ec3e48ca823997a82ab9da5e"
format_stamp: "Formatted at 2026-08-09 00:49:38 on dist-test-slave-t7g5"
server_key: "26913d71f411ea80119806bc03983d5a"
server_key_iv: "a65f56e49a767cd8be04116f1ff946b0"
server_key_version: "encryptionkey@0"
I20260809 00:49:38.462040 22270 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260809 00:49:38.465437 22290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:38.466867 22270 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:49:38.467020 22270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "42368dc7ec3e48ca823997a82ab9da5e"
format_stamp: "Formatted at 2026-08-09 00:49:38 on dist-test-slave-t7g5"
server_key: "26913d71f411ea80119806bc03983d5a"
server_key_iv: "a65f56e49a767cd8be04116f1ff946b0"
server_key_version: "encryptionkey@0"
I20260809 00:49:38.467204 22270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:38.480531 22270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:38.484905 22270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:38.485190 22270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:38.486210 22270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:49:38.487583 22270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:49:38.487658 22270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:38.487766 22270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:49:38.487820 22270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:38.519780 22270 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41771
I20260809 00:49:38.519827 22457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41771 every 8 connection(s)
I20260809 00:49:38.521080 22270 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:49:38.525499 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 22270
I20260809 00:49:38.525738 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:49:38.526324 29042 external_mini_cluster.cc:1428] Setting key 0cbb175bde3bc0aa3bb22c9629b21770
I20260809 00:49:38.532481 22074 heartbeater.cc:503] Master 127.28.92.190:37741 was elected leader, sending a full tablet report...
Aug 09 00:49:38 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236578, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:49:38.542328 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.523812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:51029 (local address 127.28.92.190:37741)
0809 00:49:38.524045 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.524052 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.525285 (+ 1233us) server_negotiation.cc:407] Connection header received
0809 00:49:38.527598 (+ 2313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.527602 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.527726 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.527826 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:38.529816 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.530594 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.532140 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.532568 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.532695 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.536410 (+ 3715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:38.536415 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:38.536418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:38.536451 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:38.538966 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.539695 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.539700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.539704 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.539855 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.540303 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.540308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.540311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.540640 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:38.540781 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.541729 (+ 948us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.541971 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 00:49:38.543304 22460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.524325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:51029)
0809 00:49:38.525075 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.525141 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.527295 (+ 2154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.528067 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.528077 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.528746 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:49:38.529590 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.529618 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.530747 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.530751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.532004 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.532016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.532827 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.532835 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.533202 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.533916 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:49:38.533947 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:49:38.536208 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:49:38.539112 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:38.539119 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:38.539133 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:38.539582 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:38.539975 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:49:38.539979 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:49:38.539981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:49:38.540179 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:49:38.540770 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:49:38.540778 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:49:38.541273 (+ 495us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.541577 (+ 304us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.542167 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":274,"threads_started":1}
I20260809 00:49:38.544575 22458 heartbeater.cc:347] Connected to a master server at 127.28.92.190:37741
I20260809 00:49:38.544924 22458 heartbeater.cc:464] Registering TS with master...
I20260809 00:49:38.545681 22458 heartbeater.cc:511] Master 127.28.92.190:37741 requested a full tablet report, sending...
I20260809 00:49:38.547083 21791 ts_manager.cc:194] Registered new tserver with Master: 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131:41771)
I20260809 00:49:38.547875 21791 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:51029
I20260809 00:49:38.554581 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:49:38.571071 22076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.559023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55330 (local address 127.28.92.190:37741)
0809 00:49:38.559243 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.559249 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.559553 (+ 304us) server_negotiation.cc:407] Connection header received
0809 00:49:38.559699 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.559703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.559767 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.559874 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:38.561274 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.562051 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.563423 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.563807 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.563924 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.566311 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:38.566316 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:38.566319 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:38.566353 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:38.568673 (+ 2320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.569334 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.569338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.569340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.569462 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.569807 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.569810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.569812 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.570181 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:38.570380 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.570599 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.570764 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:49:38.574957 21791 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55330:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:49:38.581753 21791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:49:38.613673 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.595151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55078 (local address 127.28.92.131:41771)
0809 00:49:38.605631 (+ 10480us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.605640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.605718 (+ 78us) server_negotiation.cc:407] Connection header received
0809 00:49:38.605829 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.605837 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.606131 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.606334 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:38.607554 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.608816 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.611491 (+ 2675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.612559 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.612682 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.612940 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.613174 (+ 234us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.613345 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10297,"thread_start_us":10110,"threads_started":1}
I20260809 00:49:38.613814 22476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.594727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41771 (local address 127.0.0.1:55078)
0809 00:49:38.604677 (+ 9950us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.604695 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.604810 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.606629 (+ 1819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.606634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.606665 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:38.607289 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.607308 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.608945 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.608950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.611307 (+ 2357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.611320 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.612757 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.612763 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.612950 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.613000 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.613114 (+ 114us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.613308 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9820,"mutex_wait_us":135,"thread_start_us":9393,"threads_started":1}
I20260809 00:49:38.614995 22478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.594134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:52766)
0809 00:49:38.603893 (+ 9759us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.603915 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.604040 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.606724 (+ 2684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.606729 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.606757 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:38.607382 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.607393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.609195 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.609205 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.611706 (+ 2501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.611722 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.613683 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.613691 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.613913 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.614316 (+ 403us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.614414 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.614552 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9610,"mutex_wait_us":544,"thread_start_us":10230,"threads_started":1}
I20260809 00:49:38.615056 22475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.593646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46462 (local address 127.28.92.130:40617)
0809 00:49:38.605771 (+ 12125us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.605781 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.605813 (+ 32us) server_negotiation.cc:407] Connection header received
0809 00:49:38.605936 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.605944 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.606153 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.606340 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:38.607220 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.608827 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.611905 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.613366 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.614315 (+ 949us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.614500 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.614576 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.614728 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11901,"thread_start_us":11752,"threads_started":1}
I20260809 00:49:38.615407 22473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.593525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:40617 (local address 127.0.0.1:46462)
0809 00:49:38.599327 (+ 5802us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.599384 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.599574 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.606381 (+ 6807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.606388 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.606431 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:38.606976 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.606991 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.608996 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.609005 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.611706 (+ 2701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.611722 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.613683 (+ 1961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.613691 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.613928 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.614351 (+ 423us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.614435 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.614563 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":420,"thread_start_us":456,"threads_started":1}
I20260809 00:49:38.616226 22477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.594580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52766 (local address 127.28.92.129:40681)
0809 00:49:38.606166 (+ 11586us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.606173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.606199 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:49:38.606295 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.606302 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.606517 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.606704 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:38.607573 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.609069 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.611903 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.613371 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.613995 (+ 624us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.614241 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.615721 (+ 1480us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.615912 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11412,"thread_start_us":11233,"threads_started":1}
I20260809 00:49:38.618532 22169 tablet_service.cc:1467] Processing CreateTablet for tablet 35cb7f724abd429699f9f1e36e97e48d (DEFAULT_TABLE table=test-table [id=9387b00033554704a5476005b9c5bcd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:38.618471 22358 tablet_service.cc:1467] Processing CreateTablet for tablet 35cb7f724abd429699f9f1e36e97e48d (DEFAULT_TABLE table=test-table [id=9387b00033554704a5476005b9c5bcd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:38.619756 22169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35cb7f724abd429699f9f1e36e97e48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:38.619977 22358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35cb7f724abd429699f9f1e36e97e48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:38.619769 21974 tablet_service.cc:1467] Processing CreateTablet for tablet 35cb7f724abd429699f9f1e36e97e48d (DEFAULT_TABLE table=test-table [id=9387b00033554704a5476005b9c5bcd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:49:38.621109 21974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35cb7f724abd429699f9f1e36e97e48d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:49:38.631794 22482 tablet_bootstrap.cc:492] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Bootstrap starting.
I20260809 00:49:38.634855 22483 tablet_bootstrap.cc:492] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Bootstrap starting.
I20260809 00:49:38.635954 22482 tablet_bootstrap.cc:654] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:38.638206 22482 log.cc:824] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:38.638718 22483 tablet_bootstrap.cc:654] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:38.640127 22483 log.cc:824] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:38.641448 22482 tablet_bootstrap.cc:492] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: No bootstrap required, opened a new log
I20260809 00:49:38.641734 22484 tablet_bootstrap.cc:492] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Bootstrap starting.
I20260809 00:49:38.641762 22482 ts_tablet_manager.cc:1397] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 00:49:38.643056 22483 tablet_bootstrap.cc:492] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: No bootstrap required, opened a new log
I20260809 00:49:38.643308 22483 ts_tablet_manager.cc:1397] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 00:49:38.644397 22484 tablet_bootstrap.cc:654] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Neither blocks nor log segments found. Creating new log.
I20260809 00:49:38.645392 22484 log.cc:824] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:38.648335 22484 tablet_bootstrap.cc:492] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: No bootstrap required, opened a new log
I20260809 00:49:38.648590 22484 ts_tablet_manager.cc:1397] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 00:49:38.651859 22482 raft_consensus.cc:348] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.652333 22482 raft_consensus.cc:374] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:38.652448 22482 raft_consensus.cc:729] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6784206d0a6545c19de49c79a87f0479, State: Initialized, Role: FOLLOWER
I20260809 00:49:38.653116 22482 consensus_queue.cc:260] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.653702 22483 raft_consensus.cc:348] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.654178 22483 raft_consensus.cc:374] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:38.654316 22483 raft_consensus.cc:729] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42368dc7ec3e48ca823997a82ab9da5e, State: Initialized, Role: FOLLOWER
I20260809 00:49:38.654452 22262 heartbeater.cc:503] Master 127.28.92.190:37741 was elected leader, sending a full tablet report...
I20260809 00:49:38.655059 22482 ts_tablet_manager.cc:1428] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 00:49:38.655092 22483 consensus_queue.cc:260] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.656240 22458 heartbeater.cc:503] Master 127.28.92.190:37741 was elected leader, sending a full tablet report...
I20260809 00:49:38.656888 22483 ts_tablet_manager.cc:1428] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Time spent starting tablet: real 0.013s user 0.006s sys 0.008s
I20260809 00:49:38.657425 22484 raft_consensus.cc:348] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.657950 22484 raft_consensus.cc:374] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:49:38.658097 22484 raft_consensus.cc:729] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815136bb87da4ba785ef019df6145f13, State: Initialized, Role: FOLLOWER
I20260809 00:49:38.658766 22484 consensus_queue.cc:260] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.660485 22484 ts_tablet_manager.cc:1428] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260809 00:49:38.705734 22490 raft_consensus.cc:482] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:49:38.706128 22490 raft_consensus.cc:504] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.708197 22490 leader_election.cc:288] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131:41771), 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681)
I20260809 00:49:38.714877 22477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.708884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:48531 (local address 127.28.92.129:40681)
0809 00:49:38.709093 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.709099 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.709583 (+ 484us) server_negotiation.cc:407] Connection header received
0809 00:49:38.709757 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.709763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.709844 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.709912 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:38.710569 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.711341 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.713163 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.713955 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.714097 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.714172 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.714521 (+ 349us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.714645 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 00:49:38.714912 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.708692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:34117 (local address 127.28.92.131:41771)
0809 00:49:38.708913 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.708920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.709690 (+ 770us) server_negotiation.cc:407] Connection header received
0809 00:49:38.709899 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.709905 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.709985 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.710079 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:49:38.710652 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.711434 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.713190 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.713958 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.714099 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.714181 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.714556 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.714678 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 00:49:38.715054 22498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.708478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.28.92.130:48531)
0809 00:49:38.709469 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.709485 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.709607 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.709949 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.709954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.709979 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:38.710402 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.710415 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.711468 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.711473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.713008 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.713021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.714187 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.714195 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.714361 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.714390 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.714462 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.714574 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":3,"spinlock_wait_cycles":896,"thread_start_us":790,"threads_started":1}
I20260809 00:49:38.715281 22497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.708479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41771 (local address 127.28.92.130:34117)
0809 00:49:38.709543 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0809 00:49:38.709562 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:49:38.709732 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:49:38.710107 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:49:38.710110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:49:38.710153 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:49:38.710497 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.710508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.711568 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.711572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.713036 (+ 1464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:49:38.713048 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.714231 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.714237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:49:38.714398 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.714421 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:49:38.714510 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 00:49:38.714636 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":948,"mutex_wait_us":104,"spinlock_wait_cycles":1792,"thread_start_us":554,"threads_started":1}
I20260809 00:49:38.716192 22391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb7f724abd429699f9f1e36e97e48d" candidate_uuid: "6784206d0a6545c19de49c79a87f0479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42368dc7ec3e48ca823997a82ab9da5e" is_pre_election: true
I20260809 00:49:38.716189 22005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb7f724abd429699f9f1e36e97e48d" candidate_uuid: "6784206d0a6545c19de49c79a87f0479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815136bb87da4ba785ef019df6145f13" is_pre_election: true
I20260809 00:49:38.716784 22005 raft_consensus.cc:2454] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6784206d0a6545c19de49c79a87f0479 in term 0.
I20260809 00:49:38.716779 22391 raft_consensus.cc:2454] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6784206d0a6545c19de49c79a87f0479 in term 0.
I20260809 00:49:38.717507 22111 leader_election.cc:302] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42368dc7ec3e48ca823997a82ab9da5e, 6784206d0a6545c19de49c79a87f0479; no voters:
I20260809 00:49:38.717908 22490 raft_consensus.cc:2781] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:49:38.718037 22490 raft_consensus.cc:482] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:49:38.718137 22490 raft_consensus.cc:3037] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:38.720296 22490 raft_consensus.cc:504] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.720875 22490 leader_election.cc:288] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [CANDIDATE]: Term 1 election: Requested vote from peers 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131:41771), 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681)
I20260809 00:49:38.721287 22391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb7f724abd429699f9f1e36e97e48d" candidate_uuid: "6784206d0a6545c19de49c79a87f0479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42368dc7ec3e48ca823997a82ab9da5e"
I20260809 00:49:38.721334 22005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35cb7f724abd429699f9f1e36e97e48d" candidate_uuid: "6784206d0a6545c19de49c79a87f0479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815136bb87da4ba785ef019df6145f13"
I20260809 00:49:38.721455 22391 raft_consensus.cc:3037] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:38.721503 22005 raft_consensus.cc:3037] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:49:38.723620 22391 raft_consensus.cc:2454] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6784206d0a6545c19de49c79a87f0479 in term 1.
I20260809 00:49:38.723742 22005 raft_consensus.cc:2454] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6784206d0a6545c19de49c79a87f0479 in term 1.
I20260809 00:49:38.724013 22111 leader_election.cc:302] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42368dc7ec3e48ca823997a82ab9da5e, 6784206d0a6545c19de49c79a87f0479; no voters:
I20260809 00:49:38.724267 22490 raft_consensus.cc:2781] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:49:38.724664 22490 raft_consensus.cc:686] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 1 LEADER]: Becoming Leader. State: Replica: 6784206d0a6545c19de49c79a87f0479, State: Running, Role: LEADER
I20260809 00:49:38.725155 22490 consensus_queue.cc:237] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } }
I20260809 00:49:38.729435 21789 catalog_manager.cc:5495] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6784206d0a6545c19de49c79a87f0479 (127.28.92.130). New cstate: current_term: 1 leader_uuid: "6784206d0a6545c19de49c79a87f0479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } health_report { overall_health: UNKNOWN } } }
W20260809 00:49:38.754037 22075 tablet.cc:2369] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:49:38.758883 22264 tablet.cc:2369] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:38.772416 22475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.767426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46466 (local address 127.28.92.130:40617)
0809 00:49:38.767591 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.767595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.767613 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:49:38.767699 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.767702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.767794 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.767913 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:49:38.768249 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.768987 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.770339 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.770768 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.770874 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.771380 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:49:38.771875 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:49:38.771986 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.772069 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.772134 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 00:49:38.772718 22459 tablet.cc:2369] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:49:38.780153 22005 raft_consensus.cc:1261] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Refusing update from remote peer 6784206d0a6545c19de49c79a87f0479: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:38.780153 22391 raft_consensus.cc:1261] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Refusing update from remote peer 6784206d0a6545c19de49c79a87f0479: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:49:38.781055 22490 consensus_queue.cc:1035] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:38.781334 22499 consensus_queue.cc:1035] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:49:38.804442 21791 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:38.804737 21791 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:49:38.808267 21791 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Sending DeleteTablet for 3 replicas of tablet 35cb7f724abd429699f9f1e36e97e48d
I20260809 00:49:38.809491 22169 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb7f724abd429699f9f1e36e97e48d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:38 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:46462
I20260809 00:49:38.809530 22358 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb7f724abd429699f9f1e36e97e48d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:38 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:55078
I20260809 00:49:38.809963 21974 tablet_service.cc:1514] Processing DeleteTablet for tablet 35cb7f724abd429699f9f1e36e97e48d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:49:38 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:52766
I20260809 00:49:38.810493 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 21880
I20260809 00:49:38.811468 22522 tablet_replica.cc:330] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: stopping tablet replica
I20260809 00:49:38.811877 22522 raft_consensus.cc:2229] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:38.812319 22522 raft_consensus.cc:2258] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:38.813038 22524 tablet_replica.cc:330] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: stopping tablet replica
I20260809 00:49:38.813395 22524 raft_consensus.cc:2229] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:49:38.814059 22524 raft_consensus.cc:2258] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:38.814771 22523 tablet_replica.cc:330] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: stopping tablet replica
I20260809 00:49:38.814821 22522 ts_tablet_manager.cc:1905] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:38.815150 22523 raft_consensus.cc:2229] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:49:38.815623 22523 raft_consensus.cc:2258] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:49:38.817883 22523 ts_tablet_manager.cc:1905] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:38.819833 22524 ts_tablet_manager.cc:1905] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:49:38.824514 22522 ts_tablet_manager.cc:1918] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:38.825544 22523 ts_tablet_manager.cc:1918] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:38.825809 22523 log.cc:1196] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/35cb7f724abd429699f9f1e36e97e48d
I20260809 00:49:38.826431 22523 ts_tablet_manager.cc:1939] T 35cb7f724abd429699f9f1e36e97e48d P 815136bb87da4ba785ef019df6145f13: Deleting consensus metadata
I20260809 00:49:38.828436 21771 catalog_manager.cc:4841] TS 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681): tablet 35cb7f724abd429699f9f1e36e97e48d (table test-table [id=9387b00033554704a5476005b9c5bcd3]) successfully deleted
I20260809 00:49:38.828826 22522 log.cc:1196] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/35cb7f724abd429699f9f1e36e97e48d
I20260809 00:49:38.829365 22522 ts_tablet_manager.cc:1939] T 35cb7f724abd429699f9f1e36e97e48d P 42368dc7ec3e48ca823997a82ab9da5e: Deleting consensus metadata
I20260809 00:49:38.831058 21774 catalog_manager.cc:4841] TS 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131:41771): tablet 35cb7f724abd429699f9f1e36e97e48d (table test-table [id=9387b00033554704a5476005b9c5bcd3]) successfully deleted
I20260809 00:49:38.833425 22524 ts_tablet_manager.cc:1918] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:49:38.833581 22524 log.cc:1196] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/35cb7f724abd429699f9f1e36e97e48d
I20260809 00:49:38.834038 22524 ts_tablet_manager.cc:1939] T 35cb7f724abd429699f9f1e36e97e48d P 6784206d0a6545c19de49c79a87f0479: Deleting consensus metadata
I20260809 00:49:38.835701 21774 catalog_manager.cc:4841] TS 6784206d0a6545c19de49c79a87f0479 (127.28.92.130:40617): tablet 35cb7f724abd429699f9f1e36e97e48d (table test-table [id=9387b00033554704a5476005b9c5bcd3]) successfully deleted
Aug 09 00:49:38 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:49:38.843981 22477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.811732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.28.92.129:40681)
0809 00:49:38.811908 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.811914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.824895 (+ 12981us) server_negotiation.cc:407] Connection header received
0809 00:49:38.825203 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.825209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.825302 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.825378 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:38.827599 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.828629 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.830587 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.831218 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.831361 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.837098 (+ 5737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:38.837115 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:38.837134 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:38.837183 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:38.840971 (+ 3788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.841763 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.841773 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.841776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.841948 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.842313 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.842318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.842322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.842754 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:38.843055 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.843374 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.843596 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:49:38.844651 22062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:38.934628 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 21880
I20260809 00:49:38.961606 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 22082
Aug 09 00:49:38 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:49:38.978798 22475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:38.962533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46468 (local address 127.28.92.130:40617)
0809 00:49:38.962729 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:38.962735 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:38.962755 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:49:38.962969 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:38.962975 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:38.963067 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:38.963184 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:38.964584 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.965965 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.967284 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:38.967932 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:38.968056 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:38.972199 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:38.972216 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:38.972238 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:38.972288 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:38.976073 (+ 3785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.976694 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.976703 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.976707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.976882 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:38.977208 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:38.977213 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:38.977216 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:38.977692 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:38.978034 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:38.978185 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 00:49:38.978412 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 00:49:38.979543 22256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:39.093464 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 22082
I20260809 00:49:39.121613 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 22270
Aug 09 00:49:39 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:49:39.137108 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:49:39.122415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55086 (local address 127.28.92.131:41771)
0809 00:49:39.122620 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:49:39.122625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:49:39.122644 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:49:39.122724 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:49:39.122728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:49:39.122805 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:49:39.122889 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:49:39.124188 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:39.125007 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:39.126364 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:49:39.126772 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:49:39.126876 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:49:39.131590 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:49:39.131606 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:49:39.131623 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:49:39.131657 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:49:39.134514 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:39.135171 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:39.135180 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:39.135182 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:39.135338 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:49:39.135663 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:49:39.135666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:49:39.135668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:49:39.136035 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:49:39.136265 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 00:49:39.136594 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 00:49:39.136846 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 00:49:39.137899 22452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:39.233508 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 22270
I20260809 00:49:39.251778 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 21746
I20260809 00:49:39.252974 21834 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:49:39.362164 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 21746
I20260809 00:49:59.391291 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:37741
--webserver_interface=127.28.92.190
--webserver_port=34887
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:37741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:49:59.736877 22535 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:49:59.737159 22535 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:49:59.737263 22535 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:49:59.744403 22535 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 00:49:59.744508 22535 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 00:49:59.744547 22535 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 00:49:59.744601 22535 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:49:59.744655 22535 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:49:59.744725 22535 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:49:59.744771 22535 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:49:59.744824 22535 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:49:59.754706 22535 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:37741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:37741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=34887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:49:59.755967 22535 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:49:59.757349 22535 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:49:59.782663 22542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:59.782684 22544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:49:59.782706 22547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:49:59.783242 22535 server_base.cc:1034] running on GCE node
I20260809 00:49:59.784181 22535 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:49:59.785781 22535 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:49:59.787007 22535 hybrid_clock.cc:648] HybridClock initialized: now 1786236599786919 us; error 48 us; skew 500 ppm
I20260809 00:49:59.787418 22535 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:49:59 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236599, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:49:59.794595 22535 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:49:59.796274 22535 webserver.cc:460] Webserver started at http://127.28.92.190:34887/ using document root <none> and password file <none>
I20260809 00:49:59.797044 22535 fs_manager.cc:359] Metadata directory not provided
I20260809 00:49:59.797155 22535 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:49:59.803028 22535 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 00:49:59.805932 22555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:49:59.807250 22535 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:49:59.807430 22535 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "7fb0f480c22d4e7f9e3d6229857175f2"
format_stamp: "Formatted at 2026-08-09 00:49:36 on dist-test-slave-t7g5"
server_key: "18597ea8c9aed6d31014078939d5b652"
server_key_iv: "bd370b44cdf1c8e87c34602e51934490"
server_key_version: "encryptionkey@0"
I20260809 00:49:59.808465 22535 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:49:59.859642 22535 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:49:59.863983 22535 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:49:59.864285 22535 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:49:59.882829 22535 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:37741
I20260809 00:49:59.882851 22633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:37741 every 8 connection(s)
I20260809 00:49:59.884336 22535 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:49:59.889329 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 22535
I20260809 00:49:59.890421 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:40681
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:37741
--webserver_port=38529
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:49:59.892189 22634 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:49:59.896669 22634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap starting.
I20260809 00:49:59.918516 22634 log.cc:824] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:49:59.931092 22634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:49:59.931584 22634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap complete.
I20260809 00:49:59.940658 22634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:59.941505 22634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fb0f480c22d4e7f9e3d6229857175f2, State: Initialized, Role: FOLLOWER
I20260809 00:49:59.942111 22634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:59.942330 22634 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:49:59.942447 22634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:49:59.942601 22634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 1 FOLLOWER]: Advancing to term 2
I20260809 00:49:59.946409 22634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:59.946955 22634 leader_election.cc:302] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fb0f480c22d4e7f9e3d6229857175f2; no voters:
I20260809 00:49:59.947561 22634 leader_election.cc:288] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 00:49:59.947695 22640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 00:49:59.948987 22640 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 LEADER]: Becoming Leader. State: Replica: 7fb0f480c22d4e7f9e3d6229857175f2, State: Running, Role: LEADER
I20260809 00:49:59.949635 22640 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:49:59.949958 22634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:49:59.952196 22642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fb0f480c22d4e7f9e3d6229857175f2. Latest consensus state: current_term: 2 leader_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } } }
I20260809 00:49:59.952781 22642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:59.952848 22641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } } }
I20260809 00:49:59.953365 22641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:49:59.954670 22652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:49:59.976285 22652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:49:59.978003 22652 catalog_manager.cc:1259] Loaded cluster ID: d95df49822164210847a6bb7c1db7eec
I20260809 00:49:59.978122 22652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:49:59.982438 22652 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:49:59.984122 22652 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Loaded TSK: 0
I20260809 00:50:00.015882 22652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Generated new TSK 1
I20260809 00:50:00.016407 22652 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 00:50:00.264174 22637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:00.264453 22637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:00.264569 22637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:00.271835 22637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:00.271970 22637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:00.272119 22637 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:00.281945 22637 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:40681
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=38529
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:00.283272 22637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:00.284584 22637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:00.299386 22671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:00.299372 22672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:00.302030 22674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:00.306991 22637 server_base.cc:1034] running on GCE node
I20260809 00:50:00.307700 22637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:00.308738 22637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:00.309964 22637 hybrid_clock.cc:648] HybridClock initialized: now 1786236600309897 us; error 57 us; skew 500 ppm
I20260809 00:50:00.310322 22637 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:00 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236600, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:00.313733 22637 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:50:00.315451 22637 webserver.cc:460] Webserver started at http://127.28.92.129:38529/ using document root <none> and password file <none>
I20260809 00:50:00.316190 22637 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:00.316322 22637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:00.321983 22637 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 00:50:00.324715 22684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:00.326115 22637 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:50:00.326265 22637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "815136bb87da4ba785ef019df6145f13"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0454dab0a0cc039a63f75ca534c7168d"
server_key_iv: "67fba25c379edf69d5a5e86192644cf4"
server_key_version: "encryptionkey@0"
I20260809 00:50:00.327198 22637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:00.348558 22637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:00.352622 22637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:00.352880 22637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:00.353865 22637 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:00.355233 22637 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:00.355322 22637 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:00.355432 22637 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:00.355521 22637 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:00.387081 22637 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40681
I20260809 00:50:00.387166 22853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40681 every 8 connection(s)
I20260809 00:50:00.388558 22637 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:00.392187 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 22637
I20260809 00:50:00.392999 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:40617
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:37741
--webserver_port=42299
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:50:00 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236600, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:00.415419 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:00.391676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:39087)
0809 00:50:00.392851 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:00.392917 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:00.395264 (+ 2347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:00.396778 (+ 1514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:00.396788 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:00.397498 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:00.398269 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:00.398296 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.399966 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.399971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:00.401755 (+ 1784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:00.401771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.402898 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.402907 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:00.403175 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:00.403940 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:00.403976 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:00.406669 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:00.410981 (+ 4312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:00.410992 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:00.411009 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:00.411504 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:00.412067 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:00.412071 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:00.412073 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:00.412271 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:00.413270 (+ 999us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:00.413276 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:00.413636 (+ 360us) client_negotiation.cc:769] Sending connection context
0809 00:50:00.413934 (+ 298us) client_negotiation.cc:240] Negotiation successful
0809 00:50:00.414364 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"thread_start_us":616,"threads_started":1}
I20260809 00:50:00.415784 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:00.391444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:39087 (local address 127.28.92.190:37741)
0809 00:50:00.392219 (+ 775us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:00.392236 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:00.393084 (+ 848us) server_negotiation.cc:407] Connection header received
0809 00:50:00.395872 (+ 2788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:00.395887 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:00.396240 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:00.396562 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:00.398498 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.399778 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.401905 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.402605 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.402761 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:00.407013 (+ 4252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:00.407024 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:00.407045 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:00.407095 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:00.410811 (+ 3716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:00.411672 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:00.411683 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:00.411691 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:00.411940 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:00.412427 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:00.412432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:00.412434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:00.413094 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:00.413354 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:00.414197 (+ 843us) server_negotiation.cc:299] Negotiation successful
0809 00:50:00.414674 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":306,"threads_started":1}
I20260809 00:50:00.418954 22855 heartbeater.cc:347] Connected to a master server at 127.28.92.190:37741
I20260809 00:50:00.419270 22855 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:00.420012 22855 heartbeater.cc:511] Master 127.28.92.190:37741 requested a full tablet report, sending...
I20260809 00:50:00.422571 22581 ts_manager.cc:194] Registered new tserver with Master: 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681)
I20260809 00:50:00.424664 22581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:39087
W20260809 00:50:00.727869 22861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:00.728129 22861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:00.728219 22861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:00.735127 22861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:00.735227 22861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:00.735342 22861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:00.744438 22861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:40617
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=42299
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:00.745568 22861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:00.746853 22861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:00.759298 22870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:00.759258 22874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:00.759337 22869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:00.760023 22861 server_base.cc:1034] running on GCE node
I20260809 00:50:00.760581 22861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:00.761432 22861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:00.762624 22861 hybrid_clock.cc:648] HybridClock initialized: now 1786236600762567 us; error 50 us; skew 500 ppm
I20260809 00:50:00.762915 22861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:00 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236600, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:00.765865 22861 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:50:00.767256 22861 webserver.cc:460] Webserver started at http://127.28.92.130:42299/ using document root <none> and password file <none>
I20260809 00:50:00.767885 22861 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:00.768011 22861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:00.773082 22861 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:50:00.775648 22882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:00.776852 22861 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 00:50:00.777000 22861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "6784206d0a6545c19de49c79a87f0479"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0af381d4fc2909cbac925effd4e13f41"
server_key_iv: "53179734b5e99716725cd60b6d21ccbe"
server_key_version: "encryptionkey@0"
I20260809 00:50:00.777985 22861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:00.794488 22861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:00.798048 22861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:00.798275 22861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:00.799135 22861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:00.800349 22861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:00.800436 22861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:00.800540 22861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:00.800606 22861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:00.830407 22861 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:40617
I20260809 00:50:00.830474 23060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:40617 every 8 connection(s)
I20260809 00:50:00.831833 22861 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:00.835450 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 22861
I20260809 00:50:00.836223 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:41771
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:37741
--webserver_port=38061
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 00:50:00 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236600, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:00.853029 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:00.834233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:40631 (local address 127.28.92.190:37741)
0809 00:50:00.834420 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:00.834424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:00.835635 (+ 1211us) server_negotiation.cc:407] Connection header received
0809 00:50:00.838114 (+ 2479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:00.838118 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:00.838189 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:00.838270 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:00.840063 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.840746 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.842754 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.843173 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.843264 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:00.847048 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:00.847053 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:00.847056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:00.847086 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:00.849855 (+ 2769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:00.850574 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:00.850579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:00.850582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:00.850722 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:00.851340 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:00.851344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:00.851347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:00.851675 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:00.851811 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:00.852494 (+ 683us) server_negotiation.cc:299] Negotiation successful
0809 00:50:00.852708 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:50:00.853785 23064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:00.834680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:40631)
0809 00:50:00.835451 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:00.835527 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:00.837820 (+ 2293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:00.838521 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:00.838531 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:00.839186 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:00.839906 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:00.839930 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.840903 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.840908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:00.842627 (+ 1719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:00.842643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:00.843385 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:00.843392 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:00.843648 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:00.844293 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:00.844321 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:00.846806 (+ 2485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:00.849997 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:00.850004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:00.850014 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:00.850443 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:00.850867 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:00.850871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:00.850874 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:00.851210 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:00.851839 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:00.851845 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:00.852134 (+ 289us) client_negotiation.cc:769] Sending connection context
0809 00:50:00.852358 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 00:50:00.852711 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":277,"threads_started":1}
I20260809 00:50:00.855129 23061 heartbeater.cc:347] Connected to a master server at 127.28.92.190:37741
I20260809 00:50:00.855410 23061 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:00.856145 23061 heartbeater.cc:511] Master 127.28.92.190:37741 requested a full tablet report, sending...
I20260809 00:50:00.857628 22581 ts_manager.cc:194] Registered new tserver with Master: 6784206d0a6545c19de49c79a87f0479 (127.28.92.130:40617)
I20260809 00:50:00.858460 22581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:40631
W20260809 00:50:01.167158 23066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:01.167443 23066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:01.167587 23066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:01.174660 23066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:01.174779 23066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:01.174939 23066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:01.184479 23066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:41771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=38061
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:01.185688 23066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:01.186947 23066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:01.198946 23078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:01.199018 23073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:01.199038 23074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:01.199867 23066 server_base.cc:1034] running on GCE node
I20260809 00:50:01.200423 23066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:01.201297 23066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:01.202493 23066 hybrid_clock.cc:648] HybridClock initialized: now 1786236601202449 us; error 37 us; skew 500 ppm
I20260809 00:50:01.202780 23066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:01 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236601, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:01.205766 23066 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:50:01.207043 23066 webserver.cc:460] Webserver started at http://127.28.92.131:38061/ using document root <none> and password file <none>
I20260809 00:50:01.207653 23066 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:01.207763 23066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:01.212888 23066 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:50:01.215543 23092 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:01.216790 23066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:50:01.216948 23066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "42368dc7ec3e48ca823997a82ab9da5e"
format_stamp: "Formatted at 2026-08-09 00:49:38 on dist-test-slave-t7g5"
server_key: "26913d71f411ea80119806bc03983d5a"
server_key_iv: "a65f56e49a767cd8be04116f1ff946b0"
server_key_version: "encryptionkey@0"
I20260809 00:50:01.217947 23066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:01.281076 23066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:01.285048 23066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:01.285298 23066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:01.286331 23066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:01.287663 23066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:01.287755 23066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:01.287864 23066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:01.287950 23066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:01.318559 23066 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41771
I20260809 00:50:01.318632 23250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41771 every 8 connection(s)
I20260809 00:50:01.320034 23066 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:01.326151 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 23066
Aug 09 00:50:01 dist-test-slave-t7g5 krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236601, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:01.341234 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.322601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:57119 (local address 127.28.92.190:37741)
0809 00:50:01.322783 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.322788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.323965 (+ 1177us) server_negotiation.cc:407] Connection header received
0809 00:50:01.325736 (+ 1771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.325743 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.325832 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.325951 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:01.327691 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.328758 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.330681 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.331225 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.331347 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.335109 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:01.335116 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:01.335121 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:01.335162 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:01.338129 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.338823 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.338828 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.338830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.338973 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.339397 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.339402 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.339404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.339713 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:01.339861 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.340637 (+ 776us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.340853 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:50:01.341593 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.327068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46834 (local address 127.28.92.190:37741)
0809 00:50:01.327484 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.327489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.327852 (+ 363us) server_negotiation.cc:407] Connection header received
0809 00:50:01.328000 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.328004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.328065 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.328152 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:01.329866 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.330894 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.332643 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.333269 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.333403 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.336290 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:01.336296 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:01.336299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:01.336345 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:01.338857 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.339520 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.339524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.339526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.339634 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.340018 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.340023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.340026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.340360 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:01.340631 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.340941 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.341158 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":219,"threads_started":1}
I20260809 00:50:01.342342 23253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.323107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:57119)
0809 00:50:01.323802 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:01.323847 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:01.325462 (+ 1615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:01.326133 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:01.326140 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:01.326690 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:01.327505 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.327532 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.328946 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.328950 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.330528 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.330565 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.331459 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.331465 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.331658 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.332283 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:01.332306 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:01.334893 (+ 2587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:01.338257 (+ 3364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:01.338267 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:01.338283 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:01.338698 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:01.339082 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:01.339086 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:01.339089 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:01.339278 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:01.339823 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:01.339828 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:01.340225 (+ 397us) client_negotiation.cc:769] Sending connection context
0809 00:50:01.340510 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 00:50:01.340982 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":262,"threads_started":1}
I20260809 00:50:01.343652 23251 heartbeater.cc:347] Connected to a master server at 127.28.92.190:37741
I20260809 00:50:01.343958 23251 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:01.344641 23251 heartbeater.cc:511] Master 127.28.92.190:37741 requested a full tablet report, sending...
I20260809 00:50:01.345994 22581 ts_manager.cc:194] Registered new tserver with Master: 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131:41771)
I20260809 00:50:01.346755 22581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:57119
I20260809 00:50:01.356178 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:50:01.362397 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.357121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46844 (local address 127.28.92.190:37741)
0809 00:50:01.357267 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.357271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.357640 (+ 369us) server_negotiation.cc:407] Connection header received
0809 00:50:01.357889 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.357894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.358032 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.358149 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:01.358493 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.359173 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.360605 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.361011 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.361095 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.361510 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:01.361839 (+ 329us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 00:50:01.362167 (+ 328us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46844: token expired
Metrics: {"server-negotiator.queue_time_us":49}
W20260809 00:50:01.362501 23255 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46844: token expired
W20260809 00:50:01.362998 22465 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.28.92.190:37741)
I20260809 00:50:01.374791 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.363479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46858 (local address 127.28.92.190:37741)
0809 00:50:01.363614 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.363618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.363703 (+ 85us) server_negotiation.cc:407] Connection header received
0809 00:50:01.363807 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.363811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.363869 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.363939 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:01.365214 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.365952 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.367266 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.367660 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.367746 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.370115 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:01.370120 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:01.370123 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:01.370153 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:01.372582 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.373215 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.373219 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.373221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.373355 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.373643 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.373646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.373665 (+ 19us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.373986 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:01.374174 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.374396 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.374559 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 00:50:01.378383 22581 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:50:01.385891 22581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:50:01.420991 23263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.397795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54328)
0809 00:50:01.411455 (+ 13660us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:01.411471 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:01.411583 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:01.412576 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:01.412581 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:01.412608 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:01.413088 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.413103 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.415155 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.415161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.417559 (+ 2398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.417577 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.419930 (+ 2353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.419938 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.420166 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.420218 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 00:50:01.420359 (+ 141us) client_negotiation.cc:240] Negotiation successful
0809 00:50:01.420578 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13538,"thread_start_us":11447,"threads_started":1}
I20260809 00:50:01.422407 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.397975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54328 (local address 127.28.92.129:40681)
0809 00:50:01.411164 (+ 13189us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.411173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.411700 (+ 527us) server_negotiation.cc:407] Connection header received
0809 00:50:01.411811 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.411818 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.412101 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.412294 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:01.413279 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.414962 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.417781 (+ 2819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.419357 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.419506 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.419761 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.421850 (+ 2089us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.422047 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13005,"thread_start_us":12837,"threads_started":1}
I20260809 00:50:01.422880 23264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.397529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:41771 (local address 127.0.0.1:39718)
0809 00:50:01.408328 (+ 10799us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:01.408377 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:01.408582 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:01.410360 (+ 1778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:01.410370 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:01.410404 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:01.411181 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.411200 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.414342 (+ 3142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.414348 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.418288 (+ 3940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.418304 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.420574 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.420580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.420762 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.420799 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:50:01.422350 (+ 1551us) client_negotiation.cc:240] Negotiation successful
0809 00:50:01.422506 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10501,"thread_start_us":13633,"threads_started":1}
I20260809 00:50:01.423702 23265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.397833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39718 (local address 127.28.92.131:41771)
0809 00:50:01.409335 (+ 11502us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.409345 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.409381 (+ 36us) server_negotiation.cc:407] Connection header received
0809 00:50:01.409493 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.409501 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.409794 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.410000 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:01.411447 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.413177 (+ 1730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.418502 (+ 5325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.420025 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.420154 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.420396 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.423139 (+ 2743us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.423327 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11314,"thread_start_us":11130,"threads_started":1}
I20260809 00:50:01.426709 22751 tablet_service.cc:1467] Processing CreateTablet for tablet 53218c549ab34afb9e36cc03b92214e8 (DEFAULT_TABLE table=test-table [id=17ac4eae7bff400e8492caff781e95ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:01.427385 23158 tablet_service.cc:1467] Processing CreateTablet for tablet 53218c549ab34afb9e36cc03b92214e8 (DEFAULT_TABLE table=test-table [id=17ac4eae7bff400e8492caff781e95ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:01.427904 22855 heartbeater.cc:503] Master 127.28.92.190:37741 was elected leader, sending a full tablet report...
I20260809 00:50:01.428321 22751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53218c549ab34afb9e36cc03b92214e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:01.428718 23158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53218c549ab34afb9e36cc03b92214e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:01.431756 23263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.411580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:40617 (local address 127.0.0.1:49934)
0809 00:50:01.421529 (+ 9949us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:01.421550 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:01.421668 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:01.425009 (+ 3341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:01.425014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:01.425043 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:01.425201 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.425213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.427046 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.427051 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.429016 (+ 1965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.429031 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.430874 (+ 1843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.430880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.431055 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.431089 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 00:50:01.431191 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 00:50:01.431345 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9855,"thread_start_us":12519,"threads_started":1}
I20260809 00:50:01.431795 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.411836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49934 (local address 127.28.92.130:40617)
0809 00:50:01.424415 (+ 12579us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.424424 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.424452 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:50:01.424553 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.424562 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.424793 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.424987 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:01.425358 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.426874 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.429203 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.430680 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.430906 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.431086 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.431246 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.431415 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12402,"thread_start_us":12416,"threads_started":1}
I20260809 00:50:01.435712 22968 tablet_service.cc:1467] Processing CreateTablet for tablet 53218c549ab34afb9e36cc03b92214e8 (DEFAULT_TABLE table=test-table [id=17ac4eae7bff400e8492caff781e95ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:01.437100 22968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53218c549ab34afb9e36cc03b92214e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:01.440960 23269 tablet_bootstrap.cc:492] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Bootstrap starting.
I20260809 00:50:01.444105 23269 tablet_bootstrap.cc:654] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:01.444348 23270 tablet_bootstrap.cc:492] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Bootstrap starting.
I20260809 00:50:01.445446 23269 log.cc:824] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:01.447642 23270 tablet_bootstrap.cc:654] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:01.448663 23269 tablet_bootstrap.cc:492] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: No bootstrap required, opened a new log
I20260809 00:50:01.448904 23270 log.cc:824] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:01.448976 23269 ts_tablet_manager.cc:1397] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s
I20260809 00:50:01.450991 23273 tablet_bootstrap.cc:492] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Bootstrap starting.
I20260809 00:50:01.452005 23270 tablet_bootstrap.cc:492] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: No bootstrap required, opened a new log
I20260809 00:50:01.452261 23270 ts_tablet_manager.cc:1397] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 00:50:01.453799 23273 tablet_bootstrap.cc:654] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:01.454692 23273 log.cc:824] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:01.457087 23273 tablet_bootstrap.cc:492] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: No bootstrap required, opened a new log
I20260809 00:50:01.457369 23273 ts_tablet_manager.cc:1397] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 00:50:01.459461 23269 raft_consensus.cc:348] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.459892 23269 raft_consensus.cc:374] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:01.459990 23269 raft_consensus.cc:729] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 815136bb87da4ba785ef019df6145f13, State: Initialized, Role: FOLLOWER
I20260809 00:50:01.460606 23269 consensus_queue.cc:260] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.462385 23269 ts_tablet_manager.cc:1428] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 00:50:01.462267 23270 raft_consensus.cc:348] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.462736 23270 raft_consensus.cc:374] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:01.462847 23270 raft_consensus.cc:729] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42368dc7ec3e48ca823997a82ab9da5e, State: Initialized, Role: FOLLOWER
I20260809 00:50:01.463505 23270 consensus_queue.cc:260] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.464550 23251 heartbeater.cc:503] Master 127.28.92.190:37741 was elected leader, sending a full tablet report...
I20260809 00:50:01.465139 23270 ts_tablet_manager.cc:1428] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Time spent starting tablet: real 0.013s user 0.009s sys 0.003s
I20260809 00:50:01.467160 23273 raft_consensus.cc:348] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.467471 23273 raft_consensus.cc:374] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:01.467594 23273 raft_consensus.cc:729] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6784206d0a6545c19de49c79a87f0479, State: Initialized, Role: FOLLOWER
I20260809 00:50:01.468130 23273 consensus_queue.cc:260] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.469077 23061 heartbeater.cc:503] Master 127.28.92.190:37741 was elected leader, sending a full tablet report...
I20260809 00:50:01.469477 23273 ts_tablet_manager.cc:1428] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
W20260809 00:50:01.571677 23252 tablet.cc:2369] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:50:01.583664 23063 tablet.cc:2369] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:50:01.641026 22856 tablet.cc:2369] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:50:01.689352 23278 raft_consensus.cc:482] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:50:01.689646 23278 raft_consensus.cc:504] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.691392 23278 leader_election.cc:288] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681), 6784206d0a6545c19de49c79a87f0479 (127.28.92.130:40617)
I20260809 00:50:01.697630 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.691897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:46131 (local address 127.28.92.129:40681)
0809 00:50:01.692109 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.692116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.692139 (+ 23us) server_negotiation.cc:407] Connection header received
0809 00:50:01.692409 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.692414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.692501 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.692613 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:01.693034 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.694021 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.695774 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.696837 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.696955 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.697009 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.697352 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.697443 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 00:50:01.697791 23253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.691684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.28.92.131:46131)
0809 00:50:01.692045 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:01.692066 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:01.692206 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:01.692647 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:01.692650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:01.692674 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:01.692884 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.692896 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.694159 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.694165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.695622 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.695634 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.696994 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.697000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.697191 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.697228 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 00:50:01.697327 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 00:50:01.697460 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260809 00:50:01.698546 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.691978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:35473 (local address 127.28.92.130:40617)
0809 00:50:01.692157 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.692163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.692764 (+ 601us) server_negotiation.cc:407] Connection header received
0809 00:50:01.692932 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.692937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.693012 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.693079 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:01.693713 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.694566 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.696577 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.697595 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.697766 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.697835 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.698193 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.698332 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:50:01.698570 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.691789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:40617 (local address 127.28.92.131:35473)
0809 00:50:01.692647 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:01.692666 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:01.692792 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:01.693120 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:01.693124 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:01.693149 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:01.693538 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.693551 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.694720 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.694726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.696415 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:01.696430 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.697835 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.697841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:01.698012 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.698043 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 00:50:01.698132 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 00:50:01.698264 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":1,"thread_start_us":523,"threads_started":1}
I20260809 00:50:01.699007 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53218c549ab34afb9e36cc03b92214e8" candidate_uuid: "42368dc7ec3e48ca823997a82ab9da5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815136bb87da4ba785ef019df6145f13" is_pre_election: true
I20260809 00:50:01.699556 22784 raft_consensus.cc:2454] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42368dc7ec3e48ca823997a82ab9da5e in term 0.
I20260809 00:50:01.699512 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53218c549ab34afb9e36cc03b92214e8" candidate_uuid: "42368dc7ec3e48ca823997a82ab9da5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784206d0a6545c19de49c79a87f0479" is_pre_election: true
I20260809 00:50:01.699920 22991 raft_consensus.cc:2454] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42368dc7ec3e48ca823997a82ab9da5e in term 0.
I20260809 00:50:01.700217 23094 leader_election.cc:302] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42368dc7ec3e48ca823997a82ab9da5e, 815136bb87da4ba785ef019df6145f13; no voters:
I20260809 00:50:01.700619 23278 raft_consensus.cc:2781] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:50:01.700743 23278 raft_consensus.cc:482] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:50:01.700871 23278 raft_consensus.cc:3037] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:01.703241 23278 raft_consensus.cc:504] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.703799 23278 leader_election.cc:288] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [CANDIDATE]: Term 1 election: Requested vote from peers 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681), 6784206d0a6545c19de49c79a87f0479 (127.28.92.130:40617)
I20260809 00:50:01.704227 22784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53218c549ab34afb9e36cc03b92214e8" candidate_uuid: "42368dc7ec3e48ca823997a82ab9da5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "815136bb87da4ba785ef019df6145f13"
I20260809 00:50:01.704264 22991 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53218c549ab34afb9e36cc03b92214e8" candidate_uuid: "42368dc7ec3e48ca823997a82ab9da5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6784206d0a6545c19de49c79a87f0479"
I20260809 00:50:01.704402 22784 raft_consensus.cc:3037] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:01.704437 22991 raft_consensus.cc:3037] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:01.706562 22784 raft_consensus.cc:2454] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42368dc7ec3e48ca823997a82ab9da5e in term 1.
I20260809 00:50:01.706615 22991 raft_consensus.cc:2454] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42368dc7ec3e48ca823997a82ab9da5e in term 1.
I20260809 00:50:01.706919 23094 leader_election.cc:302] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42368dc7ec3e48ca823997a82ab9da5e, 815136bb87da4ba785ef019df6145f13; no voters:
I20260809 00:50:01.707177 23278 raft_consensus.cc:2781] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:01.707583 23278 raft_consensus.cc:686] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 1 LEADER]: Becoming Leader. State: Replica: 42368dc7ec3e48ca823997a82ab9da5e, State: Running, Role: LEADER
I20260809 00:50:01.708017 23278 consensus_queue.cc:237] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } }
I20260809 00:50:01.712765 22581 catalog_manager.cc:5495] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131). New cstate: current_term: 1 leader_uuid: "42368dc7ec3e48ca823997a82ab9da5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42368dc7ec3e48ca823997a82ab9da5e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 41771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 } health_report { overall_health: UNKNOWN } } }
I20260809 00:50:01.784776 23265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.779475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39734 (local address 127.28.92.131:41771)
0809 00:50:01.779652 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.779658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.779676 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:50:01.779901 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.779905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.779983 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.780110 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:01.780510 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.781253 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.782711 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.783115 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.783222 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.783720 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:01.784201 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:50:01.784352 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.784435 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.784519 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 00:50:01.792619 22991 raft_consensus.cc:1261] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Refusing update from remote peer 42368dc7ec3e48ca823997a82ab9da5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:01.792615 22784 raft_consensus.cc:1261] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Refusing update from remote peer 42368dc7ec3e48ca823997a82ab9da5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:01.793509 23281 consensus_queue.cc:1035] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "815136bb87da4ba785ef019df6145f13" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 40681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:01.793910 23278 consensus_queue.cc:1035] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6784206d0a6545c19de49c79a87f0479" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 40617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:01.819240 22580 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:01.819536 22580 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:01.823211 22580 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Sending DeleteTablet for 3 replicas of tablet 53218c549ab34afb9e36cc03b92214e8
I20260809 00:50:01.824249 22751 tablet_service.cc:1514] Processing DeleteTablet for tablet 53218c549ab34afb9e36cc03b92214e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:01 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:54328
I20260809 00:50:01.824340 23158 tablet_service.cc:1514] Processing DeleteTablet for tablet 53218c549ab34afb9e36cc03b92214e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:01 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:39718
I20260809 00:50:01.824416 22968 tablet_service.cc:1514] Processing DeleteTablet for tablet 53218c549ab34afb9e36cc03b92214e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:01 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:49934
I20260809 00:50:01.824841 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 22637
I20260809 00:50:01.836727 23302 tablet_replica.cc:330] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: stopping tablet replica
I20260809 00:50:01.837322 23302 raft_consensus.cc:2229] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:01.838222 23302 raft_consensus.cc:2258] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:01.839104 23304 tablet_replica.cc:330] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: stopping tablet replica
I20260809 00:50:01.839540 23304 raft_consensus.cc:2229] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:01.840109 23304 raft_consensus.cc:2258] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:01.840515 23302 ts_tablet_manager.cc:1905] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:01.842600 23304 ts_tablet_manager.cc:1905] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:01.845919 23266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:01.826247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54342 (local address 127.28.92.129:40681)
0809 00:50:01.826427 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:01.826434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:01.826451 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:50:01.826508 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:01.826513 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:01.826590 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:01.826692 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:01.828809 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.830088 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.832296 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:01.833037 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:01.833155 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:01.837443 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:01.837457 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:01.837473 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:01.837512 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:01.841766 (+ 4254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.842669 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.842678 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.842681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.842883 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:01.843350 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:01.843356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:01.843359 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:01.843800 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:01.844099 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:01.845276 (+ 1177us) server_negotiation.cc:299] Negotiation successful
0809 00:50:01.845521 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:50:01.846844 22846 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:01.847071 23303 tablet_replica.cc:330] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: stopping tablet replica
I20260809 00:50:01.847498 23303 raft_consensus.cc:2229] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:50:01.848217 23303 raft_consensus.cc:2258] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:01.852098 23304 ts_tablet_manager.cc:1918] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:01.852272 23304 log.cc:1196] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/53218c549ab34afb9e36cc03b92214e8
I20260809 00:50:01.852861 23304 ts_tablet_manager.cc:1939] T 53218c549ab34afb9e36cc03b92214e8 P 6784206d0a6545c19de49c79a87f0479: Deleting consensus metadata
I20260809 00:50:01.854936 22560 catalog_manager.cc:4841] TS 6784206d0a6545c19de49c79a87f0479 (127.28.92.130:40617): tablet 53218c549ab34afb9e36cc03b92214e8 (table test-table [id=17ac4eae7bff400e8492caff781e95ea]) successfully deleted
I20260809 00:50:01.857067 23303 ts_tablet_manager.cc:1905] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:01.862564 23303 ts_tablet_manager.cc:1918] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:01.862775 23303 log.cc:1196] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/53218c549ab34afb9e36cc03b92214e8
I20260809 00:50:01.863252 23303 ts_tablet_manager.cc:1939] T 53218c549ab34afb9e36cc03b92214e8 P 42368dc7ec3e48ca823997a82ab9da5e: Deleting consensus metadata
I20260809 00:50:01.864634 22560 catalog_manager.cc:4841] TS 42368dc7ec3e48ca823997a82ab9da5e (127.28.92.131:41771): tablet 53218c549ab34afb9e36cc03b92214e8 (table test-table [id=17ac4eae7bff400e8492caff781e95ea]) successfully deleted
I20260809 00:50:02.000339 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 22637
I20260809 00:50:02.028595 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 22861
W20260809 00:50:02.028615 22558 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:40681 (error 108)
I20260809 00:50:02.030897 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.030200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54346)
0809 00:50:02.030618 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.030724 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":222,"threads_started":1}
W20260809 00:50:02.031195 22558 catalog_manager.cc:4584] TS 815136bb87da4ba785ef019df6145f13 (127.28.92.129:40681): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 53218c549ab34afb9e36cc03b92214e8: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
I20260809 00:50:02.045564 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.029892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.28.92.130:40617)
0809 00:50:02.030095 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:02.030103 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:02.030126 (+ 23us) server_negotiation.cc:407] Connection header received
0809 00:50:02.030202 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:02.030209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:02.030297 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:02.030410 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:02.032502 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:02.033228 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:02.035371 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:02.035816 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:02.035932 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:02.039547 (+ 3615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:02.039563 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:02.039580 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:02.039614 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:02.042494 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:02.043358 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:02.043364 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:02.043367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:02.043506 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:02.043919 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:02.043922 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:02.043924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:02.044312 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:02.044541 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:02.045049 (+ 508us) server_negotiation.cc:299] Negotiation successful
0809 00:50:02.045233 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:50:02.046458 23055 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:02.085022 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.084457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54348)
0809 00:50:02.084723 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.084839 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 00:50:02.086344 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.085838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54358)
0809 00:50:02.086039 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.086156 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 00:50:02.134994 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 22861
I20260809 00:50:02.147799 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.147228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54364)
0809 00:50:02.147491 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.147610 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260809 00:50:02.149160 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.148603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54366)
0809 00:50:02.148799 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.148967 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 00:50:02.162421 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 23066
I20260809 00:50:02.178880 23265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.163264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39740 (local address 127.28.92.131:41771)
0809 00:50:02.163414 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:02.163418 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:02.163615 (+ 197us) server_negotiation.cc:407] Connection header received
0809 00:50:02.163753 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:02.163760 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:02.163869 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:02.163997 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:02.165303 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:02.166634 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:02.167892 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:02.168625 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:02.168817 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:02.171441 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:02.171457 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:02.171477 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:02.171543 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:02.175601 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:02.176343 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:02.176354 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:02.176358 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:02.176563 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:02.176942 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:02.176947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:02.176951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:02.177466 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:02.177888 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:02.178182 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 00:50:02.178420 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 00:50:02.179782 23245 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:02.229883 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.229392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54370)
0809 00:50:02.229594 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.229717 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 00:50:02.231148 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.230640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54372)
0809 00:50:02.230891 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.230987 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260809 00:50:02.302376 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 23066
I20260809 00:50:02.325675 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 22535
I20260809 00:50:02.326828 22624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:02.437938 23307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:02.437290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:40681 (local address 127.0.0.1:54388)
0809 00:50:02.437603 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:02.437743 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:40681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185}
I20260809 00:50:02.437911 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 22535
I20260809 00:50:22.465320 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:37741
--webserver_interface=127.28.92.190
--webserver_port=34887
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:37741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:22.796820 23314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:22.797091 23314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:22.797209 23314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:22.804281 23314 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 00:50:22.804371 23314 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 00:50:22.804427 23314 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 00:50:22.804499 23314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:22.804563 23314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:22.804656 23314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:22.804711 23314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:22.804785 23314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:22.814307 23314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:37741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:37741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=34887
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:22.815526 23314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:22.816830 23314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:22.827899 23321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:22.827945 23322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:22.827997 23325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:22.828630 23314 server_base.cc:1034] running on GCE node
I20260809 00:50:22.829397 23314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:22.830711 23314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:22.831924 23314 hybrid_clock.cc:648] HybridClock initialized: now 1786236622831855 us; error 56 us; skew 500 ppm
I20260809 00:50:22.832223 23314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:22 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236622, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:22.839094 23314 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:50:22.840451 23314 webserver.cc:460] Webserver started at http://127.28.92.190:34887/ using document root <none> and password file <none>
I20260809 00:50:22.841109 23314 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:22.841212 23314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:22.846441 23314 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:50:22.849215 23336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:22.850484 23314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:50:22.850638 23314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "7fb0f480c22d4e7f9e3d6229857175f2"
format_stamp: "Formatted at 2026-08-09 00:49:36 on dist-test-slave-t7g5"
server_key: "18597ea8c9aed6d31014078939d5b652"
server_key_iv: "bd370b44cdf1c8e87c34602e51934490"
server_key_version: "encryptionkey@0"
I20260809 00:50:22.851567 23314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:22.883882 23314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:22.888043 23314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:22.888316 23314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:22.906736 23314 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:37741
I20260809 00:50:22.906790 23416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:37741 every 8 connection(s)
I20260809 00:50:22.908196 23314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:22.913334 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 23314
I20260809 00:50:22.914389 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:40681
--local_ip_for_outbound_sockets=127.28.92.129
--tserver_master_addrs=127.28.92.190:37741
--webserver_port=38529
--webserver_interface=127.28.92.129
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:50:22.915798 23417 sys_catalog.cc:263] Verifying existing consensus state
I20260809 00:50:22.919982 23417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap starting.
I20260809 00:50:22.941880 23417 log.cc:824] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:22.958338 23417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 00:50:22.958839 23417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Bootstrap complete.
I20260809 00:50:22.967859 23417 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:50:22.968748 23417 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fb0f480c22d4e7f9e3d6229857175f2, State: Initialized, Role: FOLLOWER
I20260809 00:50:22.969350 23417 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:50:22.969579 23417 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:22.969713 23417 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:22.969882 23417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 2 FOLLOWER]: Advancing to term 3
I20260809 00:50:22.973723 23417 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:50:22.974196 23417 leader_election.cc:302] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fb0f480c22d4e7f9e3d6229857175f2; no voters:
I20260809 00:50:22.974839 23417 leader_election.cc:288] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 00:50:22.974990 23422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 00:50:22.976135 23422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [term 3 LEADER]: Becoming Leader. State: Replica: 7fb0f480c22d4e7f9e3d6229857175f2, State: Running, Role: LEADER
I20260809 00:50:22.976742 23422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } }
I20260809 00:50:22.977041 23417 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:22.979976 23423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } } }
I20260809 00:50:22.980355 23423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:22.986016 23425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fb0f480c22d4e7f9e3d6229857175f2. Latest consensus state: current_term: 3 leader_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fb0f480c22d4e7f9e3d6229857175f2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 37741 } } }
I20260809 00:50:22.986758 23425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:22.993499 23433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:23.002735 23433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:23.004398 23433 catalog_manager.cc:1259] Loaded cluster ID: d95df49822164210847a6bb7c1db7eec
I20260809 00:50:23.004562 23433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:23.009145 23433 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:23.011404 23433 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Loaded TSK: 0
I20260809 00:50:23.011657 23433 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7fb0f480c22d4e7f9e3d6229857175f2: Loaded TSK: 1
F20260809 00:50:23.012928 23433 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe4c03c49ad google::LogMessage::Fail() at ??:0
@ 0x7fe4c03c788a google::LogMessage::SendToLog() at ??:0
@ 0x7fe4c03c44de google::LogMessage::Flush() at ??:0
@ 0x7fe4c03c5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe4c41287d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe4c411773e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe4d5df31c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe4d5df2783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe4d5e7e2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fe4d5e7e0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fe4d5ec85e9 std::function<>::operator()() at ??:0
@ 0x7fe4d5df6cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fe4d5df4c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe4d5e7c610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fe4d5e7c439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fe4c3010345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe4c301391c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fe4c3013799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fe4c2feeeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe4c62c86db start_thread at ??:0
@ 0x7fe4bf25e61f clone at ??:0
W20260809 00:50:23.317874 23420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:23.318135 23420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:23.318260 23420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:23.325345 23420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:23.325455 23420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:23.325613 23420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:23.335309 23420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:40681
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=38529
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:23.336553 23420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:23.337847 23420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:23.350462 23482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:23.350504 23484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:23.350526 23477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:23.351509 23420 server_base.cc:1034] running on GCE node
I20260809 00:50:23.352090 23420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:23.352967 23420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:23.354166 23420 hybrid_clock.cc:648] HybridClock initialized: now 1786236623354122 us; error 31 us; skew 500 ppm
I20260809 00:50:23.354472 23420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:23 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236623, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:23.357594 23420 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:50:23.359169 23420 webserver.cc:460] Webserver started at http://127.28.92.129:38529/ using document root <none> and password file <none>
I20260809 00:50:23.359803 23420 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:23.359946 23420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:23.365088 23420 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:50:23.367897 23495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:23.369113 23420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:50:23.369262 23420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "815136bb87da4ba785ef019df6145f13"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0454dab0a0cc039a63f75ca534c7168d"
server_key_iv: "67fba25c379edf69d5a5e86192644cf4"
server_key_version: "encryptionkey@0"
I20260809 00:50:23.370201 23420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:23.409245 23420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:23.413199 23420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:23.413476 23420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:23.414533 23420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:23.416515 23505 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260809 00:50:23.421767 23505 ts_tablet_manager.cc:1852] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260809 00:50:23.422760 23505 ts_tablet_manager.cc:1905] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:23.429859 23505 ts_tablet_manager.cc:1918] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:23.430060 23505 log.cc:1196] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/53218c549ab34afb9e36cc03b92214e8
I20260809 00:50:23.430440 23505 ts_tablet_manager.cc:1939] T 53218c549ab34afb9e36cc03b92214e8 P 815136bb87da4ba785ef019df6145f13: Deleting consensus metadata
I20260809 00:50:23.430756 23420 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260809 00:50:23.430863 23420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260809 00:50:23.431023 23420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:23.431095 23420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:23.462918 23420 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:40681
I20260809 00:50:23.462973 23654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:40681 every 8 connection(s)
I20260809 00:50:23.464221 23420 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:23.465643 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 23420
I20260809 00:50:23.466432 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:40617
--local_ip_for_outbound_sockets=127.28.92.130
--tserver_master_addrs=127.28.92.190:37741
--webserver_port=42299
--webserver_interface=127.28.92.130
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:50:23.469511 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:23.467459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:37249)
0809 00:50:23.468319 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:23.468638 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":349,"threads_started":1}
W20260809 00:50:23.470181 23655 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:37741 (0 consecutive failures): Network error: Failed to ping master at 127.28.92.190:37741: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
I20260809 00:50:23.471007 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:23.470690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:35775)
0809 00:50:23.470829 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:23.470904 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 00:50:23.471835 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:23.471505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:40027)
0809 00:50:23.471641 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:23.471717 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 00:50:23.472057 23655 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 00:50:23.799045 23658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:23.799319 23658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:23.799444 23658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:23.806576 23658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:23.806670 23658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:23.806818 23658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:23.816360 23658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:40617
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=42299
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:23.817587 23658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:23.818878 23658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:23.831846 23671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:23.832010 23667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:23.831969 23669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:23.832549 23658 server_base.cc:1034] running on GCE node
I20260809 00:50:23.833143 23658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:23.834077 23658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:23.835273 23658 hybrid_clock.cc:648] HybridClock initialized: now 1786236623835225 us; error 40 us; skew 500 ppm
I20260809 00:50:23.835589 23658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:23 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236623, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:23.838624 23658 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:50:23.840004 23658 webserver.cc:460] Webserver started at http://127.28.92.130:42299/ using document root <none> and password file <none>
I20260809 00:50:23.840657 23658 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:23.840776 23658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:23.845973 23658 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:50:23.848533 23686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:23.849848 23658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:50:23.850006 23658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "6784206d0a6545c19de49c79a87f0479"
format_stamp: "Formatted at 2026-08-09 00:49:37 on dist-test-slave-t7g5"
server_key: "0af381d4fc2909cbac925effd4e13f41"
server_key_iv: "53179734b5e99716725cd60b6d21ccbe"
server_key_version: "encryptionkey@0"
I20260809 00:50:23.850944 23658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:23.879899 23658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:23.883834 23658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:23.884064 23658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:23.884981 23658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:23.886375 23658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:23.886471 23658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:23.886552 23658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:23.886606 23658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:23.916890 23658 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:40617
I20260809 00:50:23.916967 23855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:40617 every 8 connection(s)
I20260809 00:50:23.918357 23658 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:23.923123 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:23.921265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:60285)
0809 00:50:23.922049 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:23.922301 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":303,"threads_started":1}
W20260809 00:50:23.923799 23856 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:37741 (0 consecutive failures): Network error: Failed to ping master at 127.28.92.190:37741: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
I20260809 00:50:23.924270 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 23658
I20260809 00:50:23.924634 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:23.924305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:55253)
0809 00:50:23.924453 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:23.924526 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 00:50:23.924885 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:41771
--local_ip_for_outbound_sockets=127.28.92.131
--tserver_master_addrs=127.28.92.190:37741
--webserver_port=38061
--webserver_interface=127.28.92.131
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:44545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:50:23.925475 23859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:23.925151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:48293)
0809 00:50:23.925286 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:23.925368 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 00:50:23.925719 23856 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 00:50:24.252928 23860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:24.253199 23860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:24.253294 23860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:24.260587 23860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:24.260692 23860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:24.260819 23860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:24.270351 23860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:44545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:41771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=38061
--tserver_master_addrs=127.28.92.190:37741
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:24.271535 23860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:24.272878 23860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:24.290639 23868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:24.290673 23873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:24.290943 23871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:24.291780 23860 server_base.cc:1034] running on GCE node
I20260809 00:50:24.292390 23860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:24.293280 23860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:24.294473 23860 hybrid_clock.cc:648] HybridClock initialized: now 1786236624294420 us; error 46 us; skew 500 ppm
I20260809 00:50:24.294757 23860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:24 dist-test-slave-t7g5 krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236624, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:24.297807 23860 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:50:24.299219 23860 webserver.cc:460] Webserver started at http://127.28.92.131:38061/ using document root <none> and password file <none>
I20260809 00:50:24.299873 23860 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:24.299993 23860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:24.305153 23860 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:50:24.307757 23886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:24.308988 23860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:50:24.309150 23860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "42368dc7ec3e48ca823997a82ab9da5e"
format_stamp: "Formatted at 2026-08-09 00:49:38 on dist-test-slave-t7g5"
server_key: "26913d71f411ea80119806bc03983d5a"
server_key_iv: "a65f56e49a767cd8be04116f1ff946b0"
server_key_version: "encryptionkey@0"
I20260809 00:50:24.310151 23860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:24.338703 23860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:24.343036 23860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:24.343298 23860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:24.344367 23860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:24.345816 23860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:24.345925 23860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:24.346036 23860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:24.346107 23860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:24.377234 23860 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:41771
I20260809 00:50:24.377303 24053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:41771 every 8 connection(s)
I20260809 00:50:24.378701 23860 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:24.382311 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 23860
I20260809 00:50:24.383800 24056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:24.381507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:39761)
0809 00:50:24.382391 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:24.382699 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":347,"threads_started":1}
W20260809 00:50:24.384548 24054 heartbeater.cc:644] Failed to heartbeat to 127.28.92.190:37741 (0 consecutive failures): Network error: Failed to ping master at 127.28.92.190:37741: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
I20260809 00:50:24.385355 24056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:24.385041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:45563)
0809 00:50:24.385171 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:24.385239 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 00:50:24.386123 24056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:24.385847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:51087)
0809 00:50:24.385952 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:24.386023 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 00:50:24.386361 24054 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 00:50:24.474187 24061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:24.472790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:54435)
0809 00:50:24.473769 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:24.473885 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":824,"thread_start_us":669,"threads_started":1}
I20260809 00:50:24.927016 24063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:24.926167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:48431)
0809 00:50:24.926670 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:24.926761 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":239,"threads_started":1}
I20260809 00:50:25.387753 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:25.386952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:41387)
0809 00:50:25.387436 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:25.387524 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":259,"threads_started":1}
I20260809 00:50:25.475844 24065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:25.475121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:53155)
0809 00:50:25.475585 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:25.475679 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":227,"threads_started":1}
I20260809 00:50:25.928617 24067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:25.927911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:51875)
0809 00:50:25.928374 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:25.928458 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":221,"threads_started":1}
I20260809 00:50:26.389344 24070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:26.388599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:33379)
0809 00:50:26.389093 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:26.389176 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":251,"threads_started":1}
I20260809 00:50:26.477492 24071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:26.476744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:58793)
0809 00:50:26.477200 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:26.477297 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":233,"threads_started":1}
I20260809 00:50:26.930176 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:26.929433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:38627)
0809 00:50:26.929922 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:26.930008 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":243,"threads_started":1}
I20260809 00:50:27.390822 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:27.390134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:37705)
0809 00:50:27.390566 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:27.390646 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":235,"threads_started":1}
I20260809 00:50:27.479128 24076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:27.478386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:34299)
0809 00:50:27.478868 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:27.478960 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":229,"threads_started":1}
I20260809 00:50:27.931869 24078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:27.931020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:45971)
0809 00:50:27.931507 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:27.931597 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":246,"threads_started":1}
I20260809 00:50:28.392447 24079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:28.391683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:42029)
0809 00:50:28.392155 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:28.392262 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":241,"threads_started":1}
I20260809 00:50:28.480654 24080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:28.479963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:47635)
0809 00:50:28.480408 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:28.480487 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":219,"threads_started":1}
I20260809 00:50:28.933584 24082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:28.932858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:51355)
0809 00:50:28.933329 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:28.933412 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":234,"threads_started":1}
I20260809 00:50:29.394155 24084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:29.393438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:40945)
0809 00:50:29.393910 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:29.393990 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":291,"threads_started":1}
I20260809 00:50:29.482456 24086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:29.481688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:37745)
0809 00:50:29.482200 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:29.482291 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":274,"threads_started":1}
I20260809 00:50:29.935246 24087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:29.934505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:59799)
0809 00:50:29.934975 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:29.935073 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":245,"threads_started":1}
I20260809 00:50:30.395875 24088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:30.395067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:57265)
0809 00:50:30.395580 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:30.395687 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":258,"threads_started":1}
I20260809 00:50:30.484241 24089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:30.483340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:42057)
0809 00:50:30.483904 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:30.483997 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":242,"threads_started":1}
I20260809 00:50:30.937072 24090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:30.936174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:44649)
0809 00:50:30.936715 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:30.936826 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":264,"threads_started":1}
I20260809 00:50:31.397606 24091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:31.396818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:49759)
0809 00:50:31.397319 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:31.397406 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":200,"threads_started":1}
I20260809 00:50:31.485950 24092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:31.485146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:38247)
0809 00:50:31.485645 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:31.485774 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":266,"threads_started":1}
I20260809 00:50:31.938745 24093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:31.938006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:39393)
0809 00:50:31.938495 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:31.938580 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":257,"threads_started":1}
I20260809 00:50:32.399235 24094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:32.398555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:53303)
0809 00:50:32.398991 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:32.399075 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":221,"threads_started":1}
I20260809 00:50:32.487835 24096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:32.487004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:47347)
0809 00:50:32.487542 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:32.487654 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":261,"threads_started":1}
I20260809 00:50:32.940595 24097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:32.939733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:43859)
0809 00:50:32.940293 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:32.940415 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":267,"threads_started":1}
I20260809 00:50:33.401021 24099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:33.400209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:52091)
0809 00:50:33.400750 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:33.400845 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":270,"threads_started":1}
I20260809 00:50:33.489426 24100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:33.488729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:43791)
0809 00:50:33.489178 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:33.489261 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":239,"threads_started":1}
I20260809 00:50:33.942430 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:33.941630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:47055)
0809 00:50:33.942163 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:33.942253 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":278,"threads_started":1}
I20260809 00:50:34.402801 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:34.402011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:54681)
0809 00:50:34.402504 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:34.402602 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":274,"threads_started":1}
I20260809 00:50:34.491139 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:34.490379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:54419)
0809 00:50:34.490856 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:34.490943 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":253,"threads_started":1}
I20260809 00:50:34.944188 24107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:34.943409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:38503)
0809 00:50:34.943903 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:34.944003 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":237,"threads_started":1}
I20260809 00:50:35.404443 24109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:35.403657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:59613)
0809 00:50:35.404141 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:35.404248 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":239,"threads_started":1}
I20260809 00:50:35.492691 24110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:35.492017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:52785)
0809 00:50:35.492451 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:35.492535 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":214,"threads_started":1}
I20260809 00:50:35.945917 24111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:35.945157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:39557)
0809 00:50:35.945610 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:35.945729 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":241,"threads_started":1}
I20260809 00:50:36.406219 24112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:36.405465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:56629)
0809 00:50:36.405965 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:36.406051 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":285,"threads_started":1}
I20260809 00:50:36.494683 24113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:36.493732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:36811)
0809 00:50:36.494353 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:36.494464 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":285,"threads_started":1}
I20260809 00:50:36.947553 24115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:36.946771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:37859)
0809 00:50:36.947255 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:36.947365 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":242,"threads_started":1}
I20260809 00:50:37.407902 24117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:37.407095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:38349)
0809 00:50:37.407576 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:37.407704 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":247,"threads_started":1}
I20260809 00:50:37.496222 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:37.495518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:33541)
0809 00:50:37.495949 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:37.496038 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":215,"threads_started":1}
I20260809 00:50:37.949419 24119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:37.948543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:56845)
0809 00:50:37.949068 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:37.949165 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":263,"threads_started":1}
I20260809 00:50:38.409578 24120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:38.408842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:40645)
0809 00:50:38.409292 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:38.409384 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":230,"threads_started":1}
I20260809 00:50:38.498059 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:38.497314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.129:55229)
0809 00:50:38.497776 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:38.497878 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":203,"threads_started":1}
I20260809 00:50:38.951359 24122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:38.950581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.130:39149)
0809 00:50:38.951073 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:38.951166 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":255,"threads_started":1}
I20260809 00:50:39.384346 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 23420
I20260809 00:50:39.402758 24124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:39.385385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40798 (local address 127.28.92.129:40681)
0809 00:50:39.386016 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:39.386037 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:39.386086 (+ 49us) server_negotiation.cc:407] Connection header received
0809 00:50:39.387766 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:39.387777 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:39.388261 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:39.388617 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:39.390323 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:39.391613 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:39.392976 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:39.393692 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:39.393870 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:39.396731 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:39.396741 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:39.396759 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:39.396825 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:39.399754 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:39.400421 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:39.400428 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:39.400434 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:39.400603 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:39.400929 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:39.400932 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:39.400934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:39.401475 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:39.401768 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:39.402103 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 00:50:39.402451 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":246,"threads_started":1}
I20260809 00:50:39.404249 23647 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:39.411450 24130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:39.410681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:37741 (local address 127.28.92.131:49309)
0809 00:50:39.411162 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:39.411279 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.190:37741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":235,"threads_started":1}
I20260809 00:50:39.488778 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 23420
I20260809 00:50:39.514046 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 23658
I20260809 00:50:39.535564 24131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:39.514998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56022 (local address 127.28.92.130:40617)
0809 00:50:39.515556 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:39.515571 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:39.515609 (+ 38us) server_negotiation.cc:407] Connection header received
0809 00:50:39.517182 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:39.517192 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:39.517641 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:39.517998 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:39.519441 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:39.520695 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:39.522315 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:39.523048 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:39.523196 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:39.528871 (+ 5675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:39.528880 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:39.528900 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:39.528951 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:39.531979 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:39.532697 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:39.532706 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:39.532713 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:39.532897 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:39.533222 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:39.533225 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:39.533227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:39.533959 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:39.534233 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:39.534705 (+ 472us) server_negotiation.cc:299] Negotiation successful
0809 00:50:39.535153 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":234,"threads_started":1}
I20260809 00:50:39.537104 23847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:39.620348 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 23658
I20260809 00:50:39.646932 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 23860
I20260809 00:50:39.664803 24134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:39.647985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52644 (local address 127.28.92.131:41771)
0809 00:50:39.648624 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:39.648639 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:39.648681 (+ 42us) server_negotiation.cc:407] Connection header received
0809 00:50:39.650415 (+ 1734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:39.650426 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:39.650857 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:39.651145 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:39.652534 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:39.653998 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:39.655276 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:39.655941 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:39.656070 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:39.658797 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:39.658805 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:39.658821 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:39.658859 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:39.661649 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:39.662305 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:39.662311 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:39.662318 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:39.662509 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:39.662908 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:39.662910 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:39.662912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:39.663433 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:39.663648 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:39.664081 (+ 433us) server_negotiation.cc:299] Negotiation successful
0809 00:50:39.664508 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":273,"threads_started":1}
I20260809 00:50:39.666266 24047 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:39.748162 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 23860
2026-08-09T00:50:39Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64781 ms)
[----------] 30 tests from SecurityITest (303577 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:50:39 dist-test-slave-t7g5 krb5kdc[24139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:50:39 dist-test-slave-t7g5 krb5kdc[24139](info): set up 2 sockets
Aug 09 00:50:39 dist-test-slave-t7g5 krb5kdc[24139](info): commencing operation
krb5kdc: starting...
W20260809 00:50:40.984391 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:50:41 dist-test-slave-t7g5 krb5kdc[24139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:50:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:50:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:50:41.270900 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35731
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:35731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:41.618165 24164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:41.618448 24164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:41.618546 24164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:41.625617 24164 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:41.625766 24164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:41.625841 24164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:41.625908 24164 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:41.625953 24164 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:41.635640 24164 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:35731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:41.636850 24164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:41.638115 24164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:41.650030 24172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:41.650102 24174 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:41.650660 24177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:41.650832 24164 server_base.cc:1034] running on GCE node
I20260809 00:50:41.651597 24164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:41.652949 24164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:41.654147 24164 hybrid_clock.cc:648] HybridClock initialized: now 1786236641654083 us; error 47 us; skew 500 ppm
I20260809 00:50:41.654474 24164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:41 dist-test-slave-t7g5 krb5kdc[24139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236641, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:41.657407 24164 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:50:41.658928 24164 webserver.cc:460] Webserver started at http://127.28.92.190:38101/ using document root <none> and password file <none>
I20260809 00:50:41.659585 24164 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:41.659706 24164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:41.659999 24164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:41.662922 24164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd"
format_stamp: "Formatted at 2026-08-09 00:50:41 on dist-test-slave-t7g5"
server_key: "e0ceec745175b2b718010ea368df0c2b"
server_key_iv: "700d51708650f76251fb59366adea872"
server_key_version: "encryptionkey@0"
I20260809 00:50:41.663635 24164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd"
format_stamp: "Formatted at 2026-08-09 00:50:41 on dist-test-slave-t7g5"
server_key: "e0ceec745175b2b718010ea368df0c2b"
server_key_iv: "700d51708650f76251fb59366adea872"
server_key_version: "encryptionkey@0"
I20260809 00:50:41.668653 24164 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:50:41.672063 24188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:41.673317 24164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 00:50:41.673482 24164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd"
format_stamp: "Formatted at 2026-08-09 00:50:41 on dist-test-slave-t7g5"
server_key: "e0ceec745175b2b718010ea368df0c2b"
server_key_iv: "700d51708650f76251fb59366adea872"
server_key_version: "encryptionkey@0"
I20260809 00:50:41.673677 24164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:41.689743 24164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:41.693598 24164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:41.693881 24164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:41.711400 24164 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:35731
I20260809 00:50:41.711419 24262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:35731 every 8 connection(s)
I20260809 00:50:41.713053 24164 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:41.715108 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 24164
I20260809 00:50:41.715342 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:50:41.716219 29042 external_mini_cluster.cc:1428] Setting key cae4c65e7b5f989d322b248942f52601
I20260809 00:50:41.718251 24263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:41.729986 24263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd: Bootstrap starting.
Aug 09 00:50:41 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:41.733345 24263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:41.734540 24263 log.cc:824] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:41.737396 24263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd: No bootstrap required, opened a new log
I20260809 00:50:41.739244 24269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:41.718352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57566 (local address 127.28.92.190:35731)
0809 00:50:41.719184 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:41.719199 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:41.719246 (+ 47us) server_negotiation.cc:407] Connection header received
0809 00:50:41.721163 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:41.721186 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:41.721577 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:41.722009 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:41.723548 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:41.724867 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:41.726243 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:41.726960 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:41.727131 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:41.731860 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:41.731870 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:41.731885 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:41.731928 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:41.735165 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:41.735936 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:41.735943 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:41.735949 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:41.736122 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:41.736536 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:41.736540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:41.736542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:41.737065 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:41.737349 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:41.737838 (+ 489us) server_negotiation.cc:299] Negotiation successful
0809 00:50:41.738255 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":346,"threads_started":1}
I20260809 00:50:41.745496 24263 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35731 } }
I20260809 00:50:41.745986 24263 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:41.746093 24263 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe7e1a62eb204cb1be1a5a030ea2a8bd, State: Initialized, Role: FOLLOWER
I20260809 00:50:41.746703 24263 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35731 } }
I20260809 00:50:41.746951 24263 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:41.747087 24263 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:41.747258 24263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:41.749420 24263 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35731 } }
I20260809 00:50:41.750020 24263 leader_election.cc:302] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe7e1a62eb204cb1be1a5a030ea2a8bd; no voters:
I20260809 00:50:41.750600 24263 leader_election.cc:288] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:50:41.750723 24271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:41.751423 24271 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [term 1 LEADER]: Becoming Leader. State: Replica: fe7e1a62eb204cb1be1a5a030ea2a8bd, State: Running, Role: LEADER
I20260809 00:50:41.751976 24271 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35731 } }
I20260809 00:50:41.752650 24263 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:41.755088 24272 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35731 } } }
I20260809 00:50:41.755564 24272 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:41.755465 24273 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe7e1a62eb204cb1be1a5a030ea2a8bd. Latest consensus state: current_term: 1 leader_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7e1a62eb204cb1be1a5a030ea2a8bd" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35731 } } }
I20260809 00:50:41.755784 24273 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:41.757505 24283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:41.762012 24283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:41.770661 24283 catalog_manager.cc:1347] Generated new cluster ID: 428edaafe35644dfabeb03fd73ec0f8f
I20260809 00:50:41.770782 24283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:41.780702 24283 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:50:41.782083 24283 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:41.790450 24283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd: Generated new TSK 0
I20260809 00:50:41.791307 24283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:50:41.859855 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35731
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:42.199278 24301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:42.199565 24301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:42.199702 24301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:42.207010 24301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:42.207126 24301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:42.207273 24301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:42.216995 24301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:42.218335 24301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:42.219640 24301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:42.232074 24307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:42.232198 24308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:42.232604 24311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:42.233207 24301 server_base.cc:1034] running on GCE node
I20260809 00:50:42.233856 24301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:42.234776 24301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:42.235978 24301 hybrid_clock.cc:648] HybridClock initialized: now 1786236642235922 us; error 41 us; skew 500 ppm
I20260809 00:50:42.236282 24301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:42 dist-test-slave-t7g5 krb5kdc[24139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:42.239383 24301 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:50:42.240867 24301 webserver.cc:460] Webserver started at http://127.28.92.129:43061/ using document root <none> and password file <none>
I20260809 00:50:42.241559 24301 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:42.241686 24301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:42.241976 24301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:42.244753 24301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "17bd89c51a444092bd3efc9b66ffcec6"
format_stamp: "Formatted at 2026-08-09 00:50:42 on dist-test-slave-t7g5"
server_key: "5e565e24d0d8b0f6d0337213d1e4439a"
server_key_iv: "2b3f97bbc346ff5b3705697575b96b48"
server_key_version: "encryptionkey@0"
I20260809 00:50:42.245507 24301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "17bd89c51a444092bd3efc9b66ffcec6"
format_stamp: "Formatted at 2026-08-09 00:50:42 on dist-test-slave-t7g5"
server_key: "5e565e24d0d8b0f6d0337213d1e4439a"
server_key_iv: "2b3f97bbc346ff5b3705697575b96b48"
server_key_version: "encryptionkey@0"
I20260809 00:50:42.250484 24301 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:50:42.253885 24323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:42.255182 24301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:50:42.255324 24301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "17bd89c51a444092bd3efc9b66ffcec6"
format_stamp: "Formatted at 2026-08-09 00:50:42 on dist-test-slave-t7g5"
server_key: "5e565e24d0d8b0f6d0337213d1e4439a"
server_key_iv: "2b3f97bbc346ff5b3705697575b96b48"
server_key_version: "encryptionkey@0"
I20260809 00:50:42.255498 24301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:42.282958 24301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:42.286831 24301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:42.287081 24301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:42.288045 24301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:42.289330 24301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:42.289407 24301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:42.289531 24301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:42.289597 24301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:42.319675 24301 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:36275
I20260809 00:50:42.319759 24488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:36275 every 8 connection(s)
I20260809 00:50:42.321022 24301 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:42.330298 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 24301
I20260809 00:50:42.330529 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:50:42.331274 29042 external_mini_cluster.cc:1428] Setting key 747c740efaf29adcfa195839fbce69b0
Aug 09 00:50:42 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:42.341972 24493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:42.323705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:51567 (local address 127.28.92.190:35731)
0809 00:50:42.324143 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:42.324149 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:42.325127 (+ 978us) server_negotiation.cc:407] Connection header received
0809 00:50:42.327015 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:42.327021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:42.327101 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:42.327233 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:42.328797 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.329593 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.331287 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.331924 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.332075 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:42.335704 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:42.335710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:42.335715 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:42.335756 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:42.338744 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:42.339670 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:42.339676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:42.339679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:42.339840 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:42.340212 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:42.340216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:42.340218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:42.340552 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:42.340693 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:42.341368 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 00:50:42.341593 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":215,"threads_started":1}
I20260809 00:50:42.342734 24494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:42.324243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35731 (local address 127.28.92.129:51567)
0809 00:50:42.324952 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:42.324998 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:42.326715 (+ 1717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:42.327436 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:42.327444 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:42.327986 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:42.328567 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:42.328585 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.329801 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.329806 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:42.331111 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:42.331124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.332182 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.332190 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:42.332434 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:42.333140 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:42.333172 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:42.335456 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:42.338907 (+ 3451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:42.338917 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:42.338952 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:42.339556 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:42.339931 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:42.339935 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:42.339937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:42.340115 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:42.340659 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:42.340665 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:42.340983 (+ 318us) client_negotiation.cc:769] Sending connection context
0809 00:50:42.341205 (+ 222us) client_negotiation.cc:240] Negotiation successful
0809 00:50:42.341603 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":258,"threads_started":1}
I20260809 00:50:42.344293 24491 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35731
I20260809 00:50:42.344609 24491 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:42.345326 24491 heartbeater.cc:511] Master 127.28.92.190:35731 requested a full tablet report, sending...
I20260809 00:50:42.347584 24208 ts_manager.cc:194] Registered new tserver with Master: 17bd89c51a444092bd3efc9b66ffcec6 (127.28.92.129:36275)
I20260809 00:50:42.349093 24208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:51567
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:50:42.396761 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35731
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:42.729489 24499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:42.729830 24499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:42.729979 24499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:42.737063 24499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:42.737191 24499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:42.737351 24499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:42.747107 24499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:42.748418 24499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:42.749799 24499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:42.762593 24506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:42.762629 24508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:42.762672 24512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:42.763703 24499 server_base.cc:1034] running on GCE node
I20260809 00:50:42.764333 24499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:42.765270 24499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:42.766491 24499 hybrid_clock.cc:648] HybridClock initialized: now 1786236642766451 us; error 31 us; skew 500 ppm
I20260809 00:50:42.766825 24499 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:42 dist-test-slave-t7g5 krb5kdc[24139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:42.769907 24499 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:50:42.771344 24499 webserver.cc:460] Webserver started at http://127.28.92.130:34417/ using document root <none> and password file <none>
I20260809 00:50:42.771998 24499 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:42.772120 24499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:42.772420 24499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:42.775309 24499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "7ac18ef0a1104e72b44c6cb1522b23b2"
format_stamp: "Formatted at 2026-08-09 00:50:42 on dist-test-slave-t7g5"
server_key: "b2156869af1fee6df18c433804c10964"
server_key_iv: "98c3570714a54f626b45c3db74d1790a"
server_key_version: "encryptionkey@0"
I20260809 00:50:42.776062 24499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "7ac18ef0a1104e72b44c6cb1522b23b2"
format_stamp: "Formatted at 2026-08-09 00:50:42 on dist-test-slave-t7g5"
server_key: "b2156869af1fee6df18c433804c10964"
server_key_iv: "98c3570714a54f626b45c3db74d1790a"
server_key_version: "encryptionkey@0"
I20260809 00:50:42.781157 24499 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:50:42.784778 24522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:42.786216 24499 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:50:42.786376 24499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "7ac18ef0a1104e72b44c6cb1522b23b2"
format_stamp: "Formatted at 2026-08-09 00:50:42 on dist-test-slave-t7g5"
server_key: "b2156869af1fee6df18c433804c10964"
server_key_iv: "98c3570714a54f626b45c3db74d1790a"
server_key_version: "encryptionkey@0"
I20260809 00:50:42.786576 24499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:42.803432 24499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:42.807331 24499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:42.807601 24499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:42.808568 24499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:42.809985 24499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:42.810067 24499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:42.810200 24499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:42.810261 24499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:42.842025 24499 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:34571
I20260809 00:50:42.842074 24682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:34571 every 8 connection(s)
I20260809 00:50:42.843345 24499 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:42.845764 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 24499
I20260809 00:50:42.845960 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:50:42.846514 29042 external_mini_cluster.cc:1428] Setting key 983f42438535c447dba669122eeb234e
Aug 09 00:50:42 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236642, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:42.864092 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:42.845985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:44573 (local address 127.28.92.190:35731)
0809 00:50:42.846811 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:42.846816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:42.847716 (+ 900us) server_negotiation.cc:407] Connection header received
0809 00:50:42.849692 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:42.849698 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:42.849780 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:42.849875 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:42.851477 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.852194 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.853918 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.854372 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.854483 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:42.858081 (+ 3598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:42.858087 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:42.858091 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:42.858130 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:42.861005 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:42.861811 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:42.861815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:42.861817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:42.861950 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:42.862398 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:42.862401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:42.862403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:42.862666 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:42.862806 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:42.863490 (+ 684us) server_negotiation.cc:299] Negotiation successful
0809 00:50:42.863710 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":709,"thread_start_us":621,"threads_started":1}
I20260809 00:50:42.864987 24690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:42.846608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35731 (local address 127.28.92.130:44573)
0809 00:50:42.847547 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:42.847595 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:42.849380 (+ 1785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:42.850164 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:42.850173 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:42.850712 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:42.851295 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:42.851312 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.852361 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.852366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:42.853779 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:42.853793 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:42.854603 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:42.854611 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:42.854847 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:42.855507 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:42.855530 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:42.857848 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:42.861154 (+ 3306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:42.861164 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:42.861181 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:42.861681 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:42.862069 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:42.862073 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:42.862077 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:42.862276 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:42.862794 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:42.862801 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:42.863123 (+ 322us) client_negotiation.cc:769] Sending connection context
0809 00:50:42.863364 (+ 241us) client_negotiation.cc:240] Negotiation successful
0809 00:50:42.863884 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":349,"threads_started":1}
I20260809 00:50:42.866639 24684 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35731
I20260809 00:50:42.866963 24684 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:42.867712 24684 heartbeater.cc:511] Master 127.28.92.190:35731 requested a full tablet report, sending...
I20260809 00:50:42.869184 24208 ts_manager.cc:194] Registered new tserver with Master: 7ac18ef0a1104e72b44c6cb1522b23b2 (127.28.92.130:34571)
I20260809 00:50:42.870029 24208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:44573
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:50:42.910650 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35731
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:43.245618 24695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:43.245936 24695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:43.246030 24695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:43.253299 24695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:43.253418 24695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:43.253568 24695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:43.263477 24695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:35731
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:43.264758 24695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:43.266063 24695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:43.278661 24700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:43.278841 24701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:43.279156 24705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:43.280103 24695 server_base.cc:1034] running on GCE node
I20260809 00:50:43.280678 24695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:43.281613 24695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:43.282860 24695 hybrid_clock.cc:648] HybridClock initialized: now 1786236643282806 us; error 39 us; skew 500 ppm
I20260809 00:50:43.283162 24695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:43 dist-test-slave-t7g5 krb5kdc[24139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236643, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:43.286355 24695 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:50:43.287698 24695 webserver.cc:460] Webserver started at http://127.28.92.131:38367/ using document root <none> and password file <none>
I20260809 00:50:43.288374 24695 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:43.288492 24695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:43.288789 24695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:43.291729 24695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "0b24516122b942f98ee6bc9f36a681a5"
format_stamp: "Formatted at 2026-08-09 00:50:43 on dist-test-slave-t7g5"
server_key: "3b5d6a894ea3af7edf3ef9fd60497a98"
server_key_iv: "249398c3a9fd72a9df6f36d3d20a17bd"
server_key_version: "encryptionkey@0"
I20260809 00:50:43.292486 24695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "0b24516122b942f98ee6bc9f36a681a5"
format_stamp: "Formatted at 2026-08-09 00:50:43 on dist-test-slave-t7g5"
server_key: "3b5d6a894ea3af7edf3ef9fd60497a98"
server_key_iv: "249398c3a9fd72a9df6f36d3d20a17bd"
server_key_version: "encryptionkey@0"
I20260809 00:50:43.297508 24695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 00:50:43.300956 24717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:43.302255 24695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:50:43.302410 24695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "0b24516122b942f98ee6bc9f36a681a5"
format_stamp: "Formatted at 2026-08-09 00:50:43 on dist-test-slave-t7g5"
server_key: "3b5d6a894ea3af7edf3ef9fd60497a98"
server_key_iv: "249398c3a9fd72a9df6f36d3d20a17bd"
server_key_version: "encryptionkey@0"
I20260809 00:50:43.302590 24695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:43.327379 24695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:43.331398 24695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:43.331669 24695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:43.332623 24695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:43.333971 24695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:43.334053 24695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:43.334179 24695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:43.334245 24695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:43.352258 24491 heartbeater.cc:503] Master 127.28.92.190:35731 was elected leader, sending a full tablet report...
I20260809 00:50:43.365216 24695 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:39731
I20260809 00:50:43.365260 24878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:39731 every 8 connection(s)
I20260809 00:50:43.366608 24695 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:43.370458 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 24695
I20260809 00:50:43.370672 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:50:43.371217 29042 external_mini_cluster.cc:1428] Setting key 117740a364898554f514d3d74a6350b2
Aug 09 00:50:43 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236643, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:43.386952 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.369193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:55737 (local address 127.28.92.190:35731)
0809 00:50:43.369722 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.369727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.370710 (+ 983us) server_negotiation.cc:407] Connection header received
0809 00:50:43.372895 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.372900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.372987 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.373083 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:43.375014 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.375824 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.377443 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.377896 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.378012 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.381365 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:43.381370 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:43.381373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:43.381407 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:43.383861 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:43.384576 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:43.384580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:43.384582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:43.384710 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:43.385136 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:43.385139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:43.385141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:43.385428 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:43.385578 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.386334 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.386572 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":248,"threads_started":1}
I20260809 00:50:43.387881 24884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.369675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:35731 (local address 127.28.92.131:55737)
0809 00:50:43.370468 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:43.370513 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:43.372570 (+ 2057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:43.373380 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:43.373392 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:43.374220 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:43.374837 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.374857 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.375996 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.376001 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.377282 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.377301 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.378125 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.378132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.378376 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.379028 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:43.379051 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:43.381155 (+ 2104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:43.383998 (+ 2843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:43.384008 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:43.384026 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:43.384455 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:43.384818 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:43.384823 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:43.384826 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:43.385019 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:43.385563 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:43.385571 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:43.385948 (+ 377us) client_negotiation.cc:769] Sending connection context
0809 00:50:43.386199 (+ 251us) client_negotiation.cc:240] Negotiation successful
0809 00:50:43.386738 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":313,"threads_started":1}
I20260809 00:50:43.389307 24879 heartbeater.cc:347] Connected to a master server at 127.28.92.190:35731
I20260809 00:50:43.389622 24879 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:43.390412 24879 heartbeater.cc:511] Master 127.28.92.190:35731 requested a full tablet report, sending...
I20260809 00:50:43.391821 24208 ts_manager.cc:194] Registered new tserver with Master: 0b24516122b942f98ee6bc9f36a681a5 (127.28.92.131:39731)
I20260809 00:50:43.392632 24208 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:55737
I20260809 00:50:43.399188 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:50:43.416061 24882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.403737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57578 (local address 127.28.92.190:35731)
0809 00:50:43.403988 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.403996 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.404316 (+ 320us) server_negotiation.cc:407] Connection header received
0809 00:50:43.404446 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.404449 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.404515 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.404592 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:43.406101 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.406917 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.408260 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.408658 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.408770 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.411122 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:43.411127 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:43.411130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:43.411165 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:43.413696 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:43.414347 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:43.414352 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:43.414356 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:43.414481 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:43.414772 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:43.414775 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:43.414777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:43.415107 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:43.415290 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.415579 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.415755 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 00:50:43.420351 24208 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:50:43.427217 24208 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:50:43.449766 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.440909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.28.92.130:34571)
0809 00:50:43.442366 (+ 1457us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.442375 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.442404 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:50:43.442498 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.442504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.442710 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.443546 (+ 836us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:43.443709 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.444649 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.447491 (+ 2842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.448598 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.448743 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.448951 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.449282 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.449452 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1280,"thread_start_us":1181,"threads_started":1}
I20260809 00:50:43.450043 24898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.440549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34571 (local address 127.0.0.1:35818)
0809 00:50:43.441096 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:43.441112 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:43.441210 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:43.442916 (+ 1706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:43.442920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:43.442948 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:43.443384 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.443397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.444791 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.444796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.447313 (+ 2517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.447328 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.448795 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.448801 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.449005 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.449102 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 00:50:43.449228 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 00:50:43.449421 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":323,"thread_start_us":307,"threads_started":1}
I20260809 00:50:43.450197 24895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.439270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42874)
0809 00:50:43.440152 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:43.440188 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:43.440380 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:43.441456 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:43.441465 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:43.441503 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:43.441945 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.441958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.444637 (+ 2679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.444642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.446921 (+ 2279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.446937 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.448999 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.449006 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.449222 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.449258 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 00:50:43.449328 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 00:50:43.449459 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":168,"thread_start_us":535,"threads_started":1}
I20260809 00:50:43.451046 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.439605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42874 (local address 127.28.92.129:36275)
0809 00:50:43.440750 (+ 1145us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.440759 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.440790 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:50:43.440891 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.440899 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.441161 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.442175 (+ 1014us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:43.442954 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.444482 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.447105 (+ 2623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.448734 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.450261 (+ 1527us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.450499 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.450574 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.450729 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":982,"thread_start_us":827,"threads_started":1}
I20260809 00:50:43.451103 24902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.441183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:39731 (local address 127.0.0.1:45966)
0809 00:50:43.441752 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:43.441768 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:43.441878 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:43.443355 (+ 1477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:43.443360 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:43.443386 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:43.443725 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.443736 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.445797 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.445802 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.447826 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.447841 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.449963 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.449970 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.450471 (+ 501us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.450503 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 00:50:43.450567 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 00:50:43.450801 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":30,"thread_start_us":910,"threads_started":1}
I20260809 00:50:43.452062 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.441813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45966 (local address 127.28.92.131:39731)
0809 00:50:43.442770 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.442778 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.442807 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:50:43.442910 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.442917 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.443126 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.443927 (+ 801us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:43.444196 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.445636 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.448000 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.449716 (+ 1716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.451317 (+ 1601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.451518 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.451583 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.451731 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":633,"threads_started":1}
I20260809 00:50:43.454293 24593 tablet_service.cc:1467] Processing CreateTablet for tablet efe03ef843494f0697906afdacc8ad3d (DEFAULT_TABLE table=test-table [id=c87dfd333b534b209aca6f86050bfa19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:43.454418 24399 tablet_service.cc:1467] Processing CreateTablet for tablet efe03ef843494f0697906afdacc8ad3d (DEFAULT_TABLE table=test-table [id=c87dfd333b534b209aca6f86050bfa19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:43.455780 24593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe03ef843494f0697906afdacc8ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:43.455861 24399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe03ef843494f0697906afdacc8ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:43.455567 24789 tablet_service.cc:1467] Processing CreateTablet for tablet efe03ef843494f0697906afdacc8ad3d (DEFAULT_TABLE table=test-table [id=c87dfd333b534b209aca6f86050bfa19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:43.456912 24789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe03ef843494f0697906afdacc8ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:43.467162 24905 tablet_bootstrap.cc:492] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Bootstrap starting.
I20260809 00:50:43.470535 24907 tablet_bootstrap.cc:492] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Bootstrap starting.
I20260809 00:50:43.471660 24905 tablet_bootstrap.cc:654] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:43.473009 24905 log.cc:824] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:43.474191 24907 tablet_bootstrap.cc:654] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:43.474735 24909 tablet_bootstrap.cc:492] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Bootstrap starting.
I20260809 00:50:43.475517 24907 log.cc:824] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:43.478426 24905 tablet_bootstrap.cc:492] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: No bootstrap required, opened a new log
I20260809 00:50:43.478502 24907 tablet_bootstrap.cc:492] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: No bootstrap required, opened a new log
I20260809 00:50:43.478727 24905 ts_tablet_manager.cc:1397] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20260809 00:50:43.478796 24907 ts_tablet_manager.cc:1397] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 00:50:43.480134 24909 tablet_bootstrap.cc:654] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:43.481395 24909 log.cc:824] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:43.484617 24909 tablet_bootstrap.cc:492] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: No bootstrap required, opened a new log
I20260809 00:50:43.484910 24909 ts_tablet_manager.cc:1397] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 00:50:43.486320 24907 raft_consensus.cc:348] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.486663 24907 raft_consensus.cc:374] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:43.486766 24907 raft_consensus.cc:729] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17bd89c51a444092bd3efc9b66ffcec6, State: Initialized, Role: FOLLOWER
I20260809 00:50:43.487351 24907 consensus_queue.cc:260] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.488444 24905 raft_consensus.cc:348] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.488896 24905 raft_consensus.cc:374] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:43.488996 24905 raft_consensus.cc:729] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ac18ef0a1104e72b44c6cb1522b23b2, State: Initialized, Role: FOLLOWER
I20260809 00:50:43.489519 24907 ts_tablet_manager.cc:1428] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260809 00:50:43.489687 24905 consensus_queue.cc:260] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.490839 24684 heartbeater.cc:503] Master 127.28.92.190:35731 was elected leader, sending a full tablet report...
I20260809 00:50:43.491519 24905 ts_tablet_manager.cc:1428] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260809 00:50:43.496712 24909 raft_consensus.cc:348] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.497049 24909 raft_consensus.cc:374] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:43.497114 24909 raft_consensus.cc:729] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b24516122b942f98ee6bc9f36a681a5, State: Initialized, Role: FOLLOWER
I20260809 00:50:43.497611 24909 consensus_queue.cc:260] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.498603 24879 heartbeater.cc:503] Master 127.28.92.190:35731 was elected leader, sending a full tablet report...
I20260809 00:50:43.499205 24909 ts_tablet_manager.cc:1428] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
W20260809 00:50:43.573379 24492 tablet.cc:2369] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:50:43.595331 24686 tablet.cc:2369] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:50:43.618168 24881 tablet.cc:2369] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:50:43.822506 24915 raft_consensus.cc:482] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:50:43.822883 24915 raft_consensus.cc:504] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.824719 24915 leader_election.cc:288] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ac18ef0a1104e72b44c6cb1522b23b2 (127.28.92.130:34571), 0b24516122b942f98ee6bc9f36a681a5 (127.28.92.131:39731)
I20260809 00:50:43.831317 24920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.824962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34571 (local address 127.28.92.129:39133)
0809 00:50:43.825579 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:43.825602 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:43.825783 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:43.826223 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:43.826228 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:43.826261 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:43.826620 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.826630 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.827811 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.827817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.829482 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.829495 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.830753 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.830757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.830883 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.830908 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 00:50:43.830979 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 00:50:43.831066 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":304,"threads_started":1}
I20260809 00:50:43.831418 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.825182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:39133 (local address 127.28.92.130:34571)
0809 00:50:43.825374 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.825378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.825701 (+ 323us) server_negotiation.cc:407] Connection header received
0809 00:50:43.825942 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.825948 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.826026 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.826166 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:43.826746 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.827680 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.829642 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.830584 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.830740 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.830826 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.831026 (+ 200us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.831155 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:50:43.832373 24922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.825732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:39731 (local address 127.28.92.129:58075)
0809 00:50:43.826503 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:43.826517 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:43.826653 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:43.827001 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:43.827006 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:43.827033 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:43.827378 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.827390 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.828596 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.828599 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.830147 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:43.830160 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.831741 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.831748 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:43.831919 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.831952 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 00:50:43.832049 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 00:50:43.832141 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":440,"threads_started":1}
I20260809 00:50:43.832459 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.825839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:58075 (local address 127.28.92.131:39731)
0809 00:50:43.826026 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.826032 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.826612 (+ 580us) server_negotiation.cc:407] Connection header received
0809 00:50:43.826829 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.826833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.826894 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.826959 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:43.827512 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.828459 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.830318 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.831449 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.831599 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.831667 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.832102 (+ 435us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.832230 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 00:50:43.832619 24621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe03ef843494f0697906afdacc8ad3d" candidate_uuid: "17bd89c51a444092bd3efc9b66ffcec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" is_pre_election: true
I20260809 00:50:43.833190 24621 raft_consensus.cc:2454] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17bd89c51a444092bd3efc9b66ffcec6 in term 0.
I20260809 00:50:43.833379 24819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe03ef843494f0697906afdacc8ad3d" candidate_uuid: "17bd89c51a444092bd3efc9b66ffcec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b24516122b942f98ee6bc9f36a681a5" is_pre_election: true
I20260809 00:50:43.833841 24819 raft_consensus.cc:2454] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17bd89c51a444092bd3efc9b66ffcec6 in term 0.
I20260809 00:50:43.833981 24327 leader_election.cc:302] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bd89c51a444092bd3efc9b66ffcec6, 7ac18ef0a1104e72b44c6cb1522b23b2; no voters:
I20260809 00:50:43.834415 24915 raft_consensus.cc:2781] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:50:43.834575 24915 raft_consensus.cc:482] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:50:43.834731 24915 raft_consensus.cc:3037] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:43.836896 24915 raft_consensus.cc:504] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.837522 24915 leader_election.cc:288] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [CANDIDATE]: Term 1 election: Requested vote from peers 7ac18ef0a1104e72b44c6cb1522b23b2 (127.28.92.130:34571), 0b24516122b942f98ee6bc9f36a681a5 (127.28.92.131:39731)
I20260809 00:50:43.837954 24621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe03ef843494f0697906afdacc8ad3d" candidate_uuid: "17bd89c51a444092bd3efc9b66ffcec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2"
I20260809 00:50:43.838021 24819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe03ef843494f0697906afdacc8ad3d" candidate_uuid: "17bd89c51a444092bd3efc9b66ffcec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b24516122b942f98ee6bc9f36a681a5"
I20260809 00:50:43.838148 24621 raft_consensus.cc:3037] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:43.838207 24819 raft_consensus.cc:3037] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:43.840293 24621 raft_consensus.cc:2454] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17bd89c51a444092bd3efc9b66ffcec6 in term 1.
I20260809 00:50:43.840404 24819 raft_consensus.cc:2454] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17bd89c51a444092bd3efc9b66ffcec6 in term 1.
I20260809 00:50:43.840688 24327 leader_election.cc:302] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17bd89c51a444092bd3efc9b66ffcec6, 7ac18ef0a1104e72b44c6cb1522b23b2; no voters:
I20260809 00:50:43.840962 24915 raft_consensus.cc:2781] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:43.841430 24915 raft_consensus.cc:686] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 1 LEADER]: Becoming Leader. State: Replica: 17bd89c51a444092bd3efc9b66ffcec6, State: Running, Role: LEADER
I20260809 00:50:43.841955 24915 consensus_queue.cc:237] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } }
I20260809 00:50:43.846172 24208 catalog_manager.cc:5495] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 17bd89c51a444092bd3efc9b66ffcec6 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "17bd89c51a444092bd3efc9b66ffcec6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17bd89c51a444092bd3efc9b66ffcec6" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 36275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 } health_report { overall_health: UNKNOWN } } }
I20260809 00:50:43.903083 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.897973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42452 (local address 127.28.92.129:36275)
0809 00:50:43.898178 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.898183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.898201 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:50:43.898293 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.898296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.898396 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.898516 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:43.898825 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.899595 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.901046 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.901441 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.901530 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.902053 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:43.902593 (+ 540us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:50:43.902697 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.902763 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.902830 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:50:43.911026 24819 raft_consensus.cc:1261] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 1 FOLLOWER]: Refusing update from remote peer 17bd89c51a444092bd3efc9b66ffcec6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:43.911091 24621 raft_consensus.cc:1261] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 1 FOLLOWER]: Refusing update from remote peer 17bd89c51a444092bd3efc9b66ffcec6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:43.911921 24915 consensus_queue.cc:1035] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b24516122b942f98ee6bc9f36a681a5" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 39731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:43.912272 24923 consensus_queue.cc:1035] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ac18ef0a1104e72b44c6cb1522b23b2" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:43.922525 24927 mvcc.cc:205] Tried to move back new op lower bound from 7316425293449654272 to 7316425293180198912. Current Snapshot: MvccSnapshot[applied={T|T < 7316425293449654272}]
I20260809 00:50:43.924921 24931 mvcc.cc:205] Tried to move back new op lower bound from 7316425293449654272 to 7316425293180198912. Current Snapshot: MvccSnapshot[applied={T|T < 7316425293449654272}]
I20260809 00:50:43.938133 24208 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:43.938441 24208 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:43.942183 24208 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fe7e1a62eb204cb1be1a5a030ea2a8bd: Sending DeleteTablet for 3 replicas of tablet efe03ef843494f0697906afdacc8ad3d
I20260809 00:50:43.943317 24399 tablet_service.cc:1514] Processing DeleteTablet for tablet efe03ef843494f0697906afdacc8ad3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:43 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:42874
I20260809 00:50:43.943558 24789 tablet_service.cc:1514] Processing DeleteTablet for tablet efe03ef843494f0697906afdacc8ad3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:43 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:45966
I20260809 00:50:43.943548 24593 tablet_service.cc:1514] Processing DeleteTablet for tablet efe03ef843494f0697906afdacc8ad3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:43 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:35818
I20260809 00:50:43.946763 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 24301
I20260809 00:50:43.956575 24945 tablet_replica.cc:330] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: stopping tablet replica
I20260809 00:50:43.957168 24945 raft_consensus.cc:2229] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:43.957674 24942 tablet_replica.cc:330] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: stopping tablet replica
I20260809 00:50:43.957976 24945 raft_consensus.cc:2258] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:43.958112 24942 raft_consensus.cc:2229] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:50:43.959021 24943 tablet_replica.cc:330] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: stopping tablet replica
I20260809 00:50:43.959421 24943 raft_consensus.cc:2229] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:43.959956 24943 raft_consensus.cc:2258] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:43.960618 24945 ts_tablet_manager.cc:1905] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:43.961570 24942 raft_consensus.cc:2258] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:43.963567 24943 ts_tablet_manager.cc:1905] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:43.967619 24945 ts_tablet_manager.cc:1918] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:43.967782 24945 log.cc:1196] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/efe03ef843494f0697906afdacc8ad3d
I20260809 00:50:43.968318 24945 ts_tablet_manager.cc:1939] T efe03ef843494f0697906afdacc8ad3d P 7ac18ef0a1104e72b44c6cb1522b23b2: Deleting consensus metadata
Aug 09 00:50:43 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:50:43.970160 24191 catalog_manager.cc:4841] TS 7ac18ef0a1104e72b44c6cb1522b23b2 (127.28.92.130:34571): tablet efe03ef843494f0697906afdacc8ad3d (table test-table [id=c87dfd333b534b209aca6f86050bfa19]) successfully deleted
I20260809 00:50:43.970455 24943 ts_tablet_manager.cc:1918] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:43.970683 24943 log.cc:1196] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/efe03ef843494f0697906afdacc8ad3d
I20260809 00:50:43.971237 24943 ts_tablet_manager.cc:1939] T efe03ef843494f0697906afdacc8ad3d P 0b24516122b942f98ee6bc9f36a681a5: Deleting consensus metadata
I20260809 00:50:43.972828 24191 catalog_manager.cc:4841] TS 0b24516122b942f98ee6bc9f36a681a5 (127.28.92.131:39731): tablet efe03ef843494f0697906afdacc8ad3d (table test-table [id=c87dfd333b534b209aca6f86050bfa19]) successfully deleted
I20260809 00:50:43.973014 24942 ts_tablet_manager.cc:1905] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:43.978725 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:43.947882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42464 (local address 127.28.92.129:36275)
0809 00:50:43.948136 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:43.948143 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:43.956199 (+ 8056us) server_negotiation.cc:407] Connection header received
0809 00:50:43.957196 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:43.957202 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:43.957310 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:43.957390 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:43.961207 (+ 3817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.962482 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.964460 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:43.965135 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:43.965233 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:43.970678 (+ 5445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:43.970697 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:43.970715 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:43.970770 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:43.975029 (+ 4259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:43.975951 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:43.975961 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:43.975964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:43.976153 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:43.976673 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:43.976679 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:43.976682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:43.977103 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:43.977408 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:43.978069 (+ 661us) server_negotiation.cc:299] Negotiation successful
0809 00:50:43.978326 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260809 00:50:43.980235 24483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:44.075073 24942 ts_tablet_manager.cc:1918] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:44.075402 24942 log.cc:1196] T efe03ef843494f0697906afdacc8ad3d P 17bd89c51a444092bd3efc9b66ffcec6: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/efe03ef843494f0697906afdacc8ad3d
I20260809 00:50:44.075927 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 24301
I20260809 00:50:44.101328 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 24499
W20260809 00:50:44.101312 24191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:36275 (error 108)
I20260809 00:50:44.103281 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.102567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42470)
0809 00:50:44.103005 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.103113 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":216,"threads_started":1}
W20260809 00:50:44.103524 24191 catalog_manager.cc:4584] TS 17bd89c51a444092bd3efc9b66ffcec6 (127.28.92.129:36275): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet efe03ef843494f0697906afdacc8ad3d: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Aug 09 00:50:44 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:50:44.116616 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.102178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.28.92.130:34571)
0809 00:50:44.102379 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:44.102385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:44.102429 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:50:44.102633 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:44.102637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:44.102701 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:44.102796 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:44.104266 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:44.104988 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:44.106418 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:44.106830 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:44.106948 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:44.111089 (+ 4141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:44.111103 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:44.111118 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:44.111150 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:44.113927 (+ 2777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:44.114591 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:44.114599 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:44.114601 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:44.114731 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:44.115097 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:44.115101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:44.115103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:44.115494 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:44.115783 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:44.116082 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 00:50:44.116292 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:50:44.117224 24678 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:44.157295 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.156702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42476)
0809 00:50:44.156963 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.157101 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 00:50:44.158615 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.158142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42484)
0809 00:50:44.158314 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.158421 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 00:50:44.209896 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 24499
I20260809 00:50:44.219415 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.218791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42496)
0809 00:50:44.219071 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.219197 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260809 00:50:44.220649 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.220157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42502)
0809 00:50:44.220338 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.220443 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 00:50:44.234663 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 24695
Aug 09 00:50:44 dist-test-slave-t7g5 krb5kdc[24139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:50:44.250595 24904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.235522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37408 (local address 127.28.92.131:39731)
0809 00:50:44.235682 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:44.235687 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:44.235705 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:50:44.235807 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:44.235811 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:44.235884 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:44.235967 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:44.237373 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:44.238184 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:44.239694 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:44.240110 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:44.240219 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:44.244810 (+ 4591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:44.244828 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:44.244847 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:44.244890 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:44.247698 (+ 2808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:44.248419 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:44.248428 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:44.248432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:44.248606 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:44.249022 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:44.249025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:44.249027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:44.249392 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:44.249608 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:44.250152 (+ 544us) server_negotiation.cc:299] Negotiation successful
0809 00:50:44.250325 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 00:50:44.251271 24874 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:44.301996 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.301396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42516)
0809 00:50:44.301645 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.301813 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260809 00:50:44.303169 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:44.302683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:36275 (local address 127.0.0.1:42518)
0809 00:50:44.302907 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:44.302998 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:36275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260809 00:50:44.339928 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 24695
I20260809 00:50:44.361620 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 24164
I20260809 00:50:44.362794 24256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:44.472609 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 24164
2026-08-09T00:50:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4732 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T00:50:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:50:44Z Disabled control of system clock
I20260809 00:50:44.566529 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:39361
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:39361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 00:50:44.928440 24960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:44.928893 24960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:44.929034 24960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:44.936646 24960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:44.936775 24960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:44.936820 24960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:44.936900 24960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:44.936954 24960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:44.946707 24960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:39361
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:39361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:44.948144 24960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:44.950157 24960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:44.961964 24971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:44.961918 24974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:44.962064 24972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:44.962936 24960 server_base.cc:1034] running on GCE node
I20260809 00:50:44.963701 24960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:44.965103 24960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:44.966313 24960 hybrid_clock.cc:648] HybridClock initialized: now 1786236644966252 us; error 49 us; skew 500 ppm
I20260809 00:50:44.966682 24960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:44.969017 24960 webserver.cc:460] Webserver started at http://127.28.92.190:38403/ using document root <none> and password file <none>
I20260809 00:50:44.969748 24960 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:44.969859 24960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:44.970181 24960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:44.973153 24960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "f1b69fbaa55f42dabc7550908f70e6a4"
format_stamp: "Formatted at 2026-08-09 00:50:44 on dist-test-slave-t7g5"
server_key: "71630269ba716cc444ec534db3be31be"
server_key_iv: "78180cfb4ad66e758e638b4fea23a2eb"
server_key_version: "encryptionkey@0"
I20260809 00:50:44.974052 24960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "f1b69fbaa55f42dabc7550908f70e6a4"
format_stamp: "Formatted at 2026-08-09 00:50:44 on dist-test-slave-t7g5"
server_key: "71630269ba716cc444ec534db3be31be"
server_key_iv: "78180cfb4ad66e758e638b4fea23a2eb"
server_key_version: "encryptionkey@0"
I20260809 00:50:44.979341 24960 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:50:44.982925 24981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:44.984252 24960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:50:44.984427 24960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "f1b69fbaa55f42dabc7550908f70e6a4"
format_stamp: "Formatted at 2026-08-09 00:50:44 on dist-test-slave-t7g5"
server_key: "71630269ba716cc444ec534db3be31be"
server_key_iv: "78180cfb4ad66e758e638b4fea23a2eb"
server_key_version: "encryptionkey@0"
I20260809 00:50:44.984633 24960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:44.996541 24960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:44.997393 24960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:44.997692 24960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:45.016920 24960 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:39361
I20260809 00:50:45.016957 25049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:39361 every 8 connection(s)
I20260809 00:50:45.018414 24960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:45.022534 25051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:45.027830 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 24960
I20260809 00:50:45.028008 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:50:45.028501 29042 external_mini_cluster.cc:1428] Setting key 5b492843905b46ee6ec6796799941b94
I20260809 00:50:45.034549 25051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4: Bootstrap starting.
I20260809 00:50:45.038075 25051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:45.039391 25051 log.cc:824] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:45.042759 25051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4: No bootstrap required, opened a new log
I20260809 00:50:45.043062 25055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:45.030664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40110 (local address 127.28.92.190:39361)
0809 00:50:45.031843 (+ 1179us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:45.031856 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:45.031904 (+ 48us) server_negotiation.cc:407] Connection header received
0809 00:50:45.033941 (+ 2037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:45.033969 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:45.034491 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:45.034911 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:45.035563 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:45.036969 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:45.038508 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:45.039240 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:45.039429 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:45.040641 (+ 1212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:45.040649 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:45.040668 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:45.041236 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:45.041322 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:45.041349 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:45.041459 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:45.041726 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 00:50:45.042060 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":437,"threads_started":1}
I20260809 00:50:45.051174 25051 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39361 } }
I20260809 00:50:45.051594 25051 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:45.051705 25051 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b69fbaa55f42dabc7550908f70e6a4, State: Initialized, Role: FOLLOWER
I20260809 00:50:45.052321 25051 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39361 } }
I20260809 00:50:45.052573 25051 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:45.052706 25051 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:45.052876 25051 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:45.055255 25051 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39361 } }
I20260809 00:50:45.055917 25051 leader_election.cc:302] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1b69fbaa55f42dabc7550908f70e6a4; no voters:
I20260809 00:50:45.056561 25051 leader_election.cc:288] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:50:45.056679 25059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:45.057448 25059 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [term 1 LEADER]: Becoming Leader. State: Replica: f1b69fbaa55f42dabc7550908f70e6a4, State: Running, Role: LEADER
I20260809 00:50:45.058027 25059 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39361 } }
I20260809 00:50:45.058713 25051 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:45.060923 25061 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1b69fbaa55f42dabc7550908f70e6a4. Latest consensus state: current_term: 1 leader_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39361 } } }
I20260809 00:50:45.061542 25061 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:45.061020 25060 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b69fbaa55f42dabc7550908f70e6a4" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 39361 } } }
I20260809 00:50:45.062155 25060 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:45.064204 25071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:45.069118 25071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:45.078429 25071 catalog_manager.cc:1347] Generated new cluster ID: 17c8339b19fb49038748bae835e020f2
I20260809 00:50:45.078544 25071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:45.092783 25071 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:50:45.094319 25071 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:45.101753 25071 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4: Generated new TSK 0
I20260809 00:50:45.102854 25071 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:50:45.107853 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39361
--builtin_ntp_servers=127.28.92.148:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 00:50:45.451584 25089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:45.451862 25089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:45.451947 25089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:45.459093 25089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:45.459187 25089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:45.459300 25089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:45.468614 25089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:45.469906 25089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:45.471640 25089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:45.484486 25096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:45.484447 25097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:45.484512 25099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:45.485203 25089 server_base.cc:1034] running on GCE node
I20260809 00:50:45.485875 25089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:45.486864 25089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:45.488075 25089 hybrid_clock.cc:648] HybridClock initialized: now 1786236645488023 us; error 35 us; skew 500 ppm
I20260809 00:50:45.488394 25089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:45.490729 25089 webserver.cc:460] Webserver started at http://127.28.92.129:45119/ using document root <none> and password file <none>
I20260809 00:50:45.491438 25089 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:45.491545 25089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:45.491847 25089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:45.494827 25089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "9b152dc0d92444b7bc87769f5a6c1454"
format_stamp: "Formatted at 2026-08-09 00:50:45 on dist-test-slave-t7g5"
server_key: "b6fe476cd7b7c0a3bb4dbfce2aa19c39"
server_key_iv: "cda45b68c547e19fa1d084f49bed8a0e"
server_key_version: "encryptionkey@0"
I20260809 00:50:45.495648 25089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "9b152dc0d92444b7bc87769f5a6c1454"
format_stamp: "Formatted at 2026-08-09 00:50:45 on dist-test-slave-t7g5"
server_key: "b6fe476cd7b7c0a3bb4dbfce2aa19c39"
server_key_iv: "cda45b68c547e19fa1d084f49bed8a0e"
server_key_version: "encryptionkey@0"
I20260809 00:50:45.500901 25089 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 00:50:45.504657 25112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:45.506096 25089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260809 00:50:45.506279 25089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "9b152dc0d92444b7bc87769f5a6c1454"
format_stamp: "Formatted at 2026-08-09 00:50:45 on dist-test-slave-t7g5"
server_key: "b6fe476cd7b7c0a3bb4dbfce2aa19c39"
server_key_iv: "cda45b68c547e19fa1d084f49bed8a0e"
server_key_version: "encryptionkey@0"
I20260809 00:50:45.506505 25089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:45.525766 25089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:45.526648 25089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:45.526957 25089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:45.527971 25089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:45.529518 25089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:45.529623 25089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:45.529757 25089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:45.529831 25089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:45.560969 25089 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:34453
I20260809 00:50:45.561038 25273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:34453 every 8 connection(s)
I20260809 00:50:45.562323 25089 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:45.568018 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 25089
I20260809 00:50:45.568167 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:50:45.568626 29042 external_mini_cluster.cc:1428] Setting key 9cd46d46fd9dea89916795e4008bb613
I20260809 00:50:45.571805 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39361
--builtin_ntp_servers=127.28.92.148:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 00:50:45.575768 25277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:45.564879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:32999 (local address 127.28.92.190:39361)
0809 00:50:45.565322 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:45.565326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:45.566511 (+ 1185us) server_negotiation.cc:407] Connection header received
0809 00:50:45.568414 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:45.568418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:45.568485 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:45.568567 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:45.569945 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:45.570948 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:45.573115 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:45.573514 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:45.573604 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:45.575060 (+ 1456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:45.575064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:45.575068 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:45.575085 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:45.575127 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:45.575139 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:45.575205 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:45.575427 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 00:50:45.575515 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":223,"threads_started":1}
I20260809 00:50:45.576960 25278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:45.565482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39361 (local address 127.28.92.129:32999)
0809 00:50:45.566348 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:45.566401 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:45.568057 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:45.568870 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:45.568881 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:45.568995 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:45.569777 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:45.569799 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:45.571118 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:45.571124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:45.572970 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:45.572986 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:45.573754 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:45.573762 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:45.574032 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:45.574729 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:50:45.574733 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:45.574784 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:50:45.574885 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:45.575223 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:45.575233 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:45.575240 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 00:50:45.575404 (+ 164us) client_negotiation.cc:240] Negotiation successful
0809 00:50:45.575787 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":277,"threads_started":1}
I20260809 00:50:45.578361 25274 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39361
I20260809 00:50:45.578665 25274 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:45.579557 25274 heartbeater.cc:511] Master 127.28.92.190:39361 requested a full tablet report, sending...
I20260809 00:50:45.581619 25006 ts_manager.cc:194] Registered new tserver with Master: 9b152dc0d92444b7bc87769f5a6c1454 (127.28.92.129:34453)
I20260809 00:50:45.583113 25006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.129:32999
W20260809 00:50:45.903612 25279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:45.903918 25279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:45.904028 25279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:45.911365 25279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:45.911494 25279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:45.911633 25279 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:45.920955 25279 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:45.922313 25279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:45.924156 25279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:45.936905 25286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:45.936952 25287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:45.936980 25289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:45.937798 25279 server_base.cc:1034] running on GCE node
I20260809 00:50:45.938452 25279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:45.939427 25279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:45.940668 25279 hybrid_clock.cc:648] HybridClock initialized: now 1786236645940603 us; error 52 us; skew 500 ppm
I20260809 00:50:45.941013 25279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:45.943327 25279 webserver.cc:460] Webserver started at http://127.28.92.130:44461/ using document root <none> and password file <none>
I20260809 00:50:45.944034 25279 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:45.944149 25279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:45.944489 25279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:45.947530 25279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "b0b871b1d7c94bd3990426764af08714"
format_stamp: "Formatted at 2026-08-09 00:50:45 on dist-test-slave-t7g5"
server_key: "fab37a9284ba0aa9c4c4782ee26c2b6a"
server_key_iv: "3edfdc3466d3194befcacfa7a68641f3"
server_key_version: "encryptionkey@0"
I20260809 00:50:45.948386 25279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "b0b871b1d7c94bd3990426764af08714"
format_stamp: "Formatted at 2026-08-09 00:50:45 on dist-test-slave-t7g5"
server_key: "fab37a9284ba0aa9c4c4782ee26c2b6a"
server_key_iv: "3edfdc3466d3194befcacfa7a68641f3"
server_key_version: "encryptionkey@0"
I20260809 00:50:45.953715 25279 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:50:45.957271 25299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:45.958693 25279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260809 00:50:45.958863 25279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "b0b871b1d7c94bd3990426764af08714"
format_stamp: "Formatted at 2026-08-09 00:50:45 on dist-test-slave-t7g5"
server_key: "fab37a9284ba0aa9c4c4782ee26c2b6a"
server_key_iv: "3edfdc3466d3194befcacfa7a68641f3"
server_key_version: "encryptionkey@0"
I20260809 00:50:45.959085 25279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:45.978128 25279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:45.979089 25279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:45.979442 25279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:45.980564 25279 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:45.982249 25279 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:45.982368 25279 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:45.982494 25279 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:45.982574 25279 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:46.015731 25279 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:38831
I20260809 00:50:46.015784 25469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:38831 every 8 connection(s)
I20260809 00:50:46.017074 25279 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:46.021162 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 25279
I20260809 00:50:46.021340 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:50:46.021970 29042 external_mini_cluster.cc:1428] Setting key d09950b8ae902083eeee5204c8460140
I20260809 00:50:46.025432 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39361
--builtin_ntp_servers=127.28.92.148:34835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 00:50:46.032251 25277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.019805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:46839 (local address 127.28.92.190:39361)
0809 00:50:46.020006 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.020011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.021744 (+ 1733us) server_negotiation.cc:407] Connection header received
0809 00:50:46.023975 (+ 2231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.023980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.024072 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.024187 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:46.025686 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.026699 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.028927 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.029588 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.029743 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.031381 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:46.031387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:46.031392 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:46.031415 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:46.031459 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:46.031476 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:46.031579 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.031807 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.031914 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 00:50:46.033574 25475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.020388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39361 (local address 127.28.92.130:46839)
0809 00:50:46.021547 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.021594 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.023649 (+ 2055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.024473 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.024484 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.024604 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:46.025435 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.025464 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.026916 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.026921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.028748 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.028764 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.029877 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.029884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.030160 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.030974 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:50:46.030977 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:46.031054 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:50:46.031168 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:46.031579 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:46.031589 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:46.031597 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.031795 (+ 198us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.032223 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":340,"threads_started":1}
I20260809 00:50:46.035192 25470 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39361
I20260809 00:50:46.035560 25470 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:46.036381 25470 heartbeater.cc:511] Master 127.28.92.190:39361 requested a full tablet report, sending...
I20260809 00:50:46.037953 25006 ts_manager.cc:194] Registered new tserver with Master: b0b871b1d7c94bd3990426764af08714 (127.28.92.130:38831)
I20260809 00:50:46.039036 25006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.130:46839
W20260809 00:50:46.366925 25477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:46.367192 25477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:46.367295 25477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:46.374476 25477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:46.374570 25477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:46.374682 25477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:46.383618 25477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:34835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:39361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:46.384866 25477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:46.386564 25477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:46.399451 25485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:46.399417 25486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:46.399372 25490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:46.400318 25477 server_base.cc:1034] running on GCE node
I20260809 00:50:46.400902 25477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:46.401851 25477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:46.403077 25477 hybrid_clock.cc:648] HybridClock initialized: now 1786236646403024 us; error 43 us; skew 500 ppm
I20260809 00:50:46.403395 25477 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:46.405731 25477 webserver.cc:460] Webserver started at http://127.28.92.131:41329/ using document root <none> and password file <none>
I20260809 00:50:46.406426 25477 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:46.406533 25477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:46.406847 25477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:46.409720 25477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "19932ba5762143e292f81fd866ccda06"
format_stamp: "Formatted at 2026-08-09 00:50:46 on dist-test-slave-t7g5"
server_key: "579662defe949c0a87d3e73fbd618981"
server_key_iv: "1275953633e65cada51708af7e127c37"
server_key_version: "encryptionkey@0"
I20260809 00:50:46.410506 25477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "19932ba5762143e292f81fd866ccda06"
format_stamp: "Formatted at 2026-08-09 00:50:46 on dist-test-slave-t7g5"
server_key: "579662defe949c0a87d3e73fbd618981"
server_key_iv: "1275953633e65cada51708af7e127c37"
server_key_version: "encryptionkey@0"
I20260809 00:50:46.415354 25477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 00:50:46.418596 25499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:46.419819 25477 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:50:46.419981 25477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "19932ba5762143e292f81fd866ccda06"
format_stamp: "Formatted at 2026-08-09 00:50:46 on dist-test-slave-t7g5"
server_key: "579662defe949c0a87d3e73fbd618981"
server_key_iv: "1275953633e65cada51708af7e127c37"
server_key_version: "encryptionkey@0"
I20260809 00:50:46.420178 25477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:46.464437 25477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:46.465284 25477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:46.465562 25477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:46.466629 25477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:46.468075 25477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:46.468173 25477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:46.468289 25477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:46.468359 25477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:46.497867 25477 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:37583
I20260809 00:50:46.497913 25662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:37583 every 8 connection(s)
I20260809 00:50:46.499105 25477 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:46.508056 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 25477
I20260809 00:50:46.508232 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:50:46.508793 29042 external_mini_cluster.cc:1428] Setting key 7dbc48f4d4beb620adf9cd15974ba3ab
I20260809 00:50:46.511289 25277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.501498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:44191 (local address 127.28.92.190:39361)
0809 00:50:46.501758 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.501765 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.503155 (+ 1390us) server_negotiation.cc:407] Connection header received
0809 00:50:46.504968 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.504973 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.505043 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.505137 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:46.506130 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.506868 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.508316 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.508950 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.509081 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.510476 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:46.510481 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:46.510484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:46.510501 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:46.510533 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:46.510545 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:46.510617 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.510884 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.511005 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 00:50:46.512426 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.502040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:39361 (local address 127.28.92.131:44191)
0809 00:50:46.502984 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.503024 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.504699 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.505323 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.505330 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.505411 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:46.506000 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.506018 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.506985 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.506988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.508152 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.508163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.509140 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.509145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.509378 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.510150 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:50:46.510153 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:46.510192 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:50:46.510281 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:46.510642 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:46.510654 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:46.510661 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.510818 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.511227 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":263,"threads_started":1}
I20260809 00:50:46.513564 25663 heartbeater.cc:347] Connected to a master server at 127.28.92.190:39361
I20260809 00:50:46.513878 25663 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:46.514590 25663 heartbeater.cc:511] Master 127.28.92.190:39361 requested a full tablet report, sending...
I20260809 00:50:46.515877 25006 ts_manager.cc:194] Registered new tserver with Master: 19932ba5762143e292f81fd866ccda06 (127.28.92.131:37583)
I20260809 00:50:46.516651 25006 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.131:44191
I20260809 00:50:46.524286 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:50:46.533995 25277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.528202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40114 (local address 127.28.92.190:39361)
0809 00:50:46.528369 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.528374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.528769 (+ 395us) server_negotiation.cc:407] Connection header received
0809 00:50:46.528919 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.528922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.528992 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.529067 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:46.529518 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.530233 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.531677 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.532322 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.532459 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.533421 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:46.533426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:46.533429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:46.533446 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:46.533480 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:46.533491 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:46.533560 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.533676 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.533763 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 00:50:46.537781 25006 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:50:46.544526 25006 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:50:46.584319 25691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.556697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37508)
0809 00:50:46.574924 (+ 18227us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.574944 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.575069 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.577038 (+ 1969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.577048 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.577103 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:46.577585 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.577598 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.579643 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.579648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.581711 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.581725 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.583311 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.583318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.583530 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.583590 (+ 60us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.583707 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.583890 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18076,"mutex_wait_us":1,"thread_start_us":12734,"threads_started":1}
I20260809 00:50:46.584352 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.557251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37508 (local address 127.28.92.129:34453)
0809 00:50:46.576293 (+ 19042us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.576301 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.576335 (+ 34us) server_negotiation.cc:407] Connection header received
0809 00:50:46.576446 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.576455 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.576741 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.576974 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:46.577856 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.579494 (+ 1638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.581960 (+ 2466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.583114 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.583249 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.583538 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.583805 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.583981 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18851,"thread_start_us":18725,"threads_started":1}
I20260809 00:50:46.585327 25686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.556529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:38831 (local address 127.0.0.1:39090)
0809 00:50:46.569972 (+ 13443us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.570022 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.570252 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.578426 (+ 8174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.578429 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.578451 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:46.578743 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.578751 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.580592 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.580597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.582752 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.582767 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.584697 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.584702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.584869 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.584900 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.584993 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.585112 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13066,"thread_start_us":22494,"threads_started":1}
I20260809 00:50:46.586007 25274 heartbeater.cc:503] Master 127.28.92.190:39361 was elected leader, sending a full tablet report...
I20260809 00:50:46.586211 25685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.556688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39090 (local address 127.28.92.130:38831)
0809 00:50:46.577596 (+ 20908us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.577605 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.577633 (+ 28us) server_negotiation.cc:407] Connection header received
0809 00:50:46.577755 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.577761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.577997 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.578184 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:46.578914 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.580411 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.582964 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.584229 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.584372 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.584584 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.585724 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.585896 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20726,"thread_start_us":21517,"threads_started":1}
I20260809 00:50:46.586901 25684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.557071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:37583 (local address 127.0.0.1:52922)
0809 00:50:46.579279 (+ 22208us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.579297 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.579421 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.579931 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.579935 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.579964 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:46.580376 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.580385 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.582305 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.582310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.584190 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.584204 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.586204 (+ 2000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.586211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.586365 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.586394 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.586485 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.586605 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22089,"thread_start_us":17537,"threads_started":1}
I20260809 00:50:46.587085 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.557695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.28.92.131:37583)
0809 00:50:46.575656 (+ 17961us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.575666 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.579435 (+ 3769us) server_negotiation.cc:407] Connection header received
0809 00:50:46.579550 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.579557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.579744 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.579902 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:46.580560 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.582137 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.584438 (+ 2301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.585728 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.585877 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.586084 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.586557 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.586715 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17738,"thread_start_us":17968,"threads_started":1}
I20260809 00:50:46.589500 25180 tablet_service.cc:1467] Processing CreateTablet for tablet 3636f1ab59a743c38bf5d51476a5818b (DEFAULT_TABLE table=test-table [id=22777e854e9d4061acf8f7d08b135573]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:46.589751 25376 tablet_service.cc:1467] Processing CreateTablet for tablet 3636f1ab59a743c38bf5d51476a5818b (DEFAULT_TABLE table=test-table [id=22777e854e9d4061acf8f7d08b135573]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:46.591101 25180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3636f1ab59a743c38bf5d51476a5818b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:46.591164 25376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3636f1ab59a743c38bf5d51476a5818b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:46.590958 25564 tablet_service.cc:1467] Processing CreateTablet for tablet 3636f1ab59a743c38bf5d51476a5818b (DEFAULT_TABLE table=test-table [id=22777e854e9d4061acf8f7d08b135573]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:46.592300 25564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3636f1ab59a743c38bf5d51476a5818b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:46.603258 25695 tablet_bootstrap.cc:492] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Bootstrap starting.
I20260809 00:50:46.606377 25695 tablet_bootstrap.cc:654] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:46.607348 25695 log.cc:824] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:46.608250 25696 tablet_bootstrap.cc:492] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Bootstrap starting.
I20260809 00:50:46.609174 25697 tablet_bootstrap.cc:492] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Bootstrap starting.
I20260809 00:50:46.611686 25695 tablet_bootstrap.cc:492] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: No bootstrap required, opened a new log
I20260809 00:50:46.612030 25695 ts_tablet_manager.cc:1397] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 00:50:46.612845 25696 tablet_bootstrap.cc:654] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:46.613214 25697 tablet_bootstrap.cc:654] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:46.614135 25696 log.cc:824] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:46.614415 25697 log.cc:824] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:46.616855 25696 tablet_bootstrap.cc:492] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: No bootstrap required, opened a new log
I20260809 00:50:46.617100 25696 ts_tablet_manager.cc:1397] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260809 00:50:46.617187 25697 tablet_bootstrap.cc:492] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: No bootstrap required, opened a new log
I20260809 00:50:46.617458 25697 ts_tablet_manager.cc:1397] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260809 00:50:46.621446 25695 raft_consensus.cc:348] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.621910 25695 raft_consensus.cc:374] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:46.622021 25695 raft_consensus.cc:729] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b152dc0d92444b7bc87769f5a6c1454, State: Initialized, Role: FOLLOWER
I20260809 00:50:46.622783 25695 consensus_queue.cc:260] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.624727 25696 raft_consensus.cc:348] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.625042 25695 ts_tablet_manager.cc:1428] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260809 00:50:46.625255 25696 raft_consensus.cc:374] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:46.625375 25696 raft_consensus.cc:729] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0b871b1d7c94bd3990426764af08714, State: Initialized, Role: FOLLOWER
I20260809 00:50:46.626027 25696 consensus_queue.cc:260] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.627152 25470 heartbeater.cc:503] Master 127.28.92.190:39361 was elected leader, sending a full tablet report...
I20260809 00:50:46.627441 25697 raft_consensus.cc:348] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.627745 25697 raft_consensus.cc:374] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:46.627843 25697 raft_consensus.cc:729] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19932ba5762143e292f81fd866ccda06, State: Initialized, Role: FOLLOWER
I20260809 00:50:46.628387 25697 consensus_queue.cc:260] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.628986 25696 ts_tablet_manager.cc:1428] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260809 00:50:46.629925 25663 heartbeater.cc:503] Master 127.28.92.190:39361 was elected leader, sending a full tablet report...
I20260809 00:50:46.630565 25697 ts_tablet_manager.cc:1428] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Time spent starting tablet: real 0.013s user 0.004s sys 0.010s
W20260809 00:50:46.750752 25666 tablet.cc:2369] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:50:46.769094 25472 tablet.cc:2369] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 00:50:46.815778 25276 tablet.cc:2369] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:50:46.854645 25704 raft_consensus.cc:482] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:50:46.855008 25704 raft_consensus.cc:504] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.856837 25704 leader_election.cc:288] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0b871b1d7c94bd3990426764af08714 (127.28.92.130:38831), 9b152dc0d92444b7bc87769f5a6c1454 (127.28.92.129:34453)
I20260809 00:50:46.862905 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.857446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:46169 (local address 127.28.92.129:34453)
0809 00:50:46.857682 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.857689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.857713 (+ 24us) server_negotiation.cc:407] Connection header received
0809 00:50:46.857907 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.857912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.858005 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.858113 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:46.858686 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.859572 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.861253 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.862081 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.862222 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.862293 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.862526 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.862654 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 00:50:46.862936 25667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.857206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.28.92.131:46169)
0809 00:50:46.857573 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.857592 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.857740 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.858192 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.858197 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.858227 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:46.858491 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.858500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.859710 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.859715 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.861084 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.861097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.862222 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.862228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.862374 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.862398 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.862494 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.862658 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"spinlock_wait_cycles":20736}
I20260809 00:50:46.863197 25685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.857396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:41193 (local address 127.28.92.130:38831)
0809 00:50:46.857593 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.857598 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.858279 (+ 681us) server_negotiation.cc:407] Connection header received
0809 00:50:46.858424 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.858427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.858495 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.858564 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:46.859151 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.859885 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.861560 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.862321 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.862466 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.862532 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.862810 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.862938 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 00:50:46.863346 25705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.857456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:38831 (local address 127.28.92.131:41193)
0809 00:50:46.858169 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:46.858192 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:46.858317 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:46.858617 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:46.858621 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:46.858646 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:46.859004 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.859016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.860037 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.860043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.861379 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:46.861392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.862484 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.862490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:46.862672 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.862696 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:50:46.862777 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 00:50:46.862903 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":1,"thread_start_us":416,"threads_started":1}
I20260809 00:50:46.864018 25206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3636f1ab59a743c38bf5d51476a5818b" candidate_uuid: "19932ba5762143e292f81fd866ccda06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b152dc0d92444b7bc87769f5a6c1454" is_pre_election: true
I20260809 00:50:46.864217 25404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3636f1ab59a743c38bf5d51476a5818b" candidate_uuid: "19932ba5762143e292f81fd866ccda06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b871b1d7c94bd3990426764af08714" is_pre_election: true
I20260809 00:50:46.864491 25206 raft_consensus.cc:2454] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19932ba5762143e292f81fd866ccda06 in term 0.
I20260809 00:50:46.864722 25404 raft_consensus.cc:2454] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19932ba5762143e292f81fd866ccda06 in term 0.
I20260809 00:50:46.865162 25500 leader_election.cc:302] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19932ba5762143e292f81fd866ccda06, 9b152dc0d92444b7bc87769f5a6c1454; no voters:
I20260809 00:50:46.865576 25704 raft_consensus.cc:2781] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:50:46.865758 25704 raft_consensus.cc:482] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:50:46.865870 25704 raft_consensus.cc:3037] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:46.868237 25704 raft_consensus.cc:504] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.868852 25704 leader_election.cc:288] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [CANDIDATE]: Term 1 election: Requested vote from peers b0b871b1d7c94bd3990426764af08714 (127.28.92.130:38831), 9b152dc0d92444b7bc87769f5a6c1454 (127.28.92.129:34453)
I20260809 00:50:46.869227 25404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3636f1ab59a743c38bf5d51476a5818b" candidate_uuid: "19932ba5762143e292f81fd866ccda06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0b871b1d7c94bd3990426764af08714"
I20260809 00:50:46.869324 25206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3636f1ab59a743c38bf5d51476a5818b" candidate_uuid: "19932ba5762143e292f81fd866ccda06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b152dc0d92444b7bc87769f5a6c1454"
I20260809 00:50:46.869452 25404 raft_consensus.cc:3037] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:46.869544 25206 raft_consensus.cc:3037] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:46.872685 25404 raft_consensus.cc:2454] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19932ba5762143e292f81fd866ccda06 in term 1.
I20260809 00:50:46.872685 25206 raft_consensus.cc:2454] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19932ba5762143e292f81fd866ccda06 in term 1.
I20260809 00:50:46.873135 25500 leader_election.cc:302] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19932ba5762143e292f81fd866ccda06, 9b152dc0d92444b7bc87769f5a6c1454; no voters:
I20260809 00:50:46.873425 25704 raft_consensus.cc:2781] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:46.873878 25704 raft_consensus.cc:686] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 1 LEADER]: Becoming Leader. State: Replica: 19932ba5762143e292f81fd866ccda06, State: Running, Role: LEADER
I20260809 00:50:46.874342 25704 consensus_queue.cc:237] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } }
I20260809 00:50:46.878650 25006 catalog_manager.cc:5495] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19932ba5762143e292f81fd866ccda06 (127.28.92.131). New cstate: current_term: 1 leader_uuid: "19932ba5762143e292f81fd866ccda06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19932ba5762143e292f81fd866ccda06" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 37583 } health_report { overall_health: HEALTHY } } }
I20260809 00:50:46.948443 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.942997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.28.92.131:37583)
0809 00:50:46.943182 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.943188 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:46.943313 (+ 125us) server_negotiation.cc:407] Connection header received
0809 00:50:46.943531 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:46.943535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:46.943613 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:46.943745 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:46.944126 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.944830 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.946342 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:46.946752 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:46.946869 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:46.947339 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:46.947841 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:50:46.947996 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:46.948126 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 00:50:46.948206 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:50:46.956102 25404 raft_consensus.cc:1261] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 1 FOLLOWER]: Refusing update from remote peer 19932ba5762143e292f81fd866ccda06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:46.956103 25206 raft_consensus.cc:1261] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 1 FOLLOWER]: Refusing update from remote peer 19932ba5762143e292f81fd866ccda06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:46.957170 25704 consensus_queue.cc:1035] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b152dc0d92444b7bc87769f5a6c1454" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:46.957484 25706 consensus_queue.cc:1035] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0b871b1d7c94bd3990426764af08714" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 38831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:46.980922 25006 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:46.981201 25006 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:46.984620 25006 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f1b69fbaa55f42dabc7550908f70e6a4: Sending DeleteTablet for 3 replicas of tablet 3636f1ab59a743c38bf5d51476a5818b
I20260809 00:50:46.985728 25180 tablet_service.cc:1514] Processing DeleteTablet for tablet 3636f1ab59a743c38bf5d51476a5818b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:46 UTC) from {username='slave'} at 127.0.0.1:37508
I20260809 00:50:46.985724 25376 tablet_service.cc:1514] Processing DeleteTablet for tablet 3636f1ab59a743c38bf5d51476a5818b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:46 UTC) from {username='slave'} at 127.0.0.1:39090
I20260809 00:50:46.985992 25564 tablet_service.cc:1514] Processing DeleteTablet for tablet 3636f1ab59a743c38bf5d51476a5818b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:46 UTC) from {username='slave'} at 127.0.0.1:52922
I20260809 00:50:46.986583 25724 tablet_replica.cc:330] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: stopping tablet replica
I20260809 00:50:46.987049 25724 raft_consensus.cc:2229] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:46.987320 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 25089
I20260809 00:50:46.987607 25724 raft_consensus.cc:2258] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:46.989907 25724 ts_tablet_manager.cc:1905] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:46.996954 25724 ts_tablet_manager.cc:1918] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:46.997170 25724 log.cc:1196] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/3636f1ab59a743c38bf5d51476a5818b
I20260809 00:50:46.997779 25724 ts_tablet_manager.cc:1939] T 3636f1ab59a743c38bf5d51476a5818b P b0b871b1d7c94bd3990426764af08714: Deleting consensus metadata
I20260809 00:50:46.998121 25728 tablet_replica.cc:330] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: stopping tablet replica
I20260809 00:50:46.999191 25728 raft_consensus.cc:2229] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:50:46.999696 24987 catalog_manager.cc:4841] TS b0b871b1d7c94bd3990426764af08714 (127.28.92.130:38831): tablet 3636f1ab59a743c38bf5d51476a5818b (table test-table [id=22777e854e9d4061acf8f7d08b135573]) successfully deleted
I20260809 00:50:47.000445 25728 raft_consensus.cc:2258] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:47.002570 25726 tablet_replica.cc:330] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: stopping tablet replica
I20260809 00:50:47.003055 25726 raft_consensus.cc:2229] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:47.003458 25728 ts_tablet_manager.cc:1905] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:47.003687 25726 raft_consensus.cc:2258] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:47.005990 25726 ts_tablet_manager.cc:1905] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:47.010483 25728 ts_tablet_manager.cc:1918] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:47.010718 25728 log.cc:1196] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/3636f1ab59a743c38bf5d51476a5818b
I20260809 00:50:47.011281 25728 ts_tablet_manager.cc:1939] T 3636f1ab59a743c38bf5d51476a5818b P 19932ba5762143e292f81fd866ccda06: Deleting consensus metadata
I20260809 00:50:47.011557 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:46.989045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37518 (local address 127.28.92.129:34453)
0809 00:50:46.989225 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:46.989232 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:47.002804 (+ 13572us) server_negotiation.cc:407] Connection header received
0809 00:50:47.002966 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:47.002971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:47.003104 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:47.003223 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:47.003913 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:47.005330 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:47.007321 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:47.008001 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:47.008104 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:47.009627 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:47.009639 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:47.009702 (+ 63us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:47.010512 (+ 810us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:47.010582 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:47.010610 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:47.010705 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:47.011028 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 00:50:47.011153 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:50:47.012936 25265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:47.013132 24989 catalog_manager.cc:4841] TS 19932ba5762143e292f81fd866ccda06 (127.28.92.131:37583): tablet 3636f1ab59a743c38bf5d51476a5818b (table test-table [id=22777e854e9d4061acf8f7d08b135573]) successfully deleted
I20260809 00:50:47.140208 25726 ts_tablet_manager.cc:1918] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:47.140477 25726 log.cc:1196] T 3636f1ab59a743c38bf5d51476a5818b P 9b152dc0d92444b7bc87769f5a6c1454: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/3636f1ab59a743c38bf5d51476a5818b
I20260809 00:50:47.141031 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 25089
W20260809 00:50:47.167618 24982 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:34453 (error 108)
I20260809 00:50:47.168429 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 25279
I20260809 00:50:47.170131 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.168858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37524)
0809 00:50:47.169785 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.169928 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":767,"thread_start_us":675,"threads_started":1}
W20260809 00:50:47.170432 24982 catalog_manager.cc:4584] TS 9b152dc0d92444b7bc87769f5a6c1454 (127.28.92.129:34453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3636f1ab59a743c38bf5d51476a5818b: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
I20260809 00:50:47.175622 25685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.169201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39106 (local address 127.28.92.130:38831)
0809 00:50:47.169393 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:47.169400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:47.169717 (+ 317us) server_negotiation.cc:407] Connection header received
0809 00:50:47.169796 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:47.169802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:47.169890 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:47.169977 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:47.170459 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:47.171218 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:47.172514 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:47.172956 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:47.173068 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:47.174260 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:47.174270 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:47.174284 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:47.174878 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:47.174926 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:47.174947 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:47.175048 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:47.175182 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 00:50:47.175294 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:50:47.176256 25465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:47.224315 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.223727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37534)
0809 00:50:47.223998 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.224110 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260809 00:50:47.225574 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.225096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37540)
0809 00:50:47.225261 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.225356 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 00:50:47.265367 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 25279
I20260809 00:50:47.286139 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.285630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37550)
0809 00:50:47.285888 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.285981 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 00:50:47.287241 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.286880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37552)
0809 00:50:47.287030 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.287100 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 00:50:47.297035 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 25477
I20260809 00:50:47.303937 25694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.297961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52950 (local address 127.28.92.131:37583)
0809 00:50:47.298161 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:47.298167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:47.298189 (+ 22us) server_negotiation.cc:407] Connection header received
0809 00:50:47.298263 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:47.298266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:47.298363 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:47.298447 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:47.298866 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:47.299630 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:47.300911 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:47.301346 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:47.301459 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:47.302545 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:47.302558 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:47.302574 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:47.303191 (+ 617us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:47.303243 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:47.303265 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:47.303376 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:47.303506 (+ 130us) server_negotiation.cc:299] Negotiation successful
0809 00:50:47.303601 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 00:50:47.304716 25658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:47.367872 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.367257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37564)
0809 00:50:47.367524 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.367658 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 00:50:47.369063 25740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:47.368557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:34453 (local address 127.0.0.1:37568)
0809 00:50:47.368782 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:47.368874 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:34453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 00:50:47.426412 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 25477
I20260809 00:50:47.450107 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 24960
I20260809 00:50:47.451238 25043 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:47.560185 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 24960
2026-08-09T00:50:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3082 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:50:47 dist-test-slave-t7g5 krb5kdc[25747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:50:47 dist-test-slave-t7g5 krb5kdc[25747](info): set up 2 sockets
Aug 09 00:50:47 dist-test-slave-t7g5 krb5kdc[25747](info): commencing operation
krb5kdc: starting...
W20260809 00:50:48.783771 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.004s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:50:48 dist-test-slave-t7g5 krb5kdc[25747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:50:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:50:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:50:49.079257 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34931
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34931
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:49.420905 25770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:49.421237 25770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:49.421382 25770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:49.428836 25770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:49.429003 25770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:49.429088 25770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:49.429169 25770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:49.429229 25770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:49.439630 25770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34931
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34931
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:49.441058 25770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:49.442448 25770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:49.454177 25778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:49.454200 25781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:49.454200 25779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:49.455017 25770 server_base.cc:1034] running on GCE node
I20260809 00:50:49.455843 25770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:49.457253 25770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:49.458451 25770 hybrid_clock.cc:648] HybridClock initialized: now 1786236649458392 us; error 45 us; skew 500 ppm
I20260809 00:50:49.458768 25770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:49 dist-test-slave-t7g5 krb5kdc[25747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236649, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:49.461905 25770 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:50:49.463416 25770 webserver.cc:460] Webserver started at http://127.28.92.190:46831/ using document root <none> and password file <none>
I20260809 00:50:49.464073 25770 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:49.464180 25770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:49.464437 25770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:49.467455 25770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "2a1867bb546a444d9fea48e0c7d24911"
format_stamp: "Formatted at 2026-08-09 00:50:49 on dist-test-slave-t7g5"
server_key: "5cba25b2cd5f6a514bc3223eeb9b65f5"
server_key_iv: "5b475a7b90354fd4f9b9702e4942408e"
server_key_version: "encryptionkey@0"
I20260809 00:50:49.468170 25770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "2a1867bb546a444d9fea48e0c7d24911"
format_stamp: "Formatted at 2026-08-09 00:50:49 on dist-test-slave-t7g5"
server_key: "5cba25b2cd5f6a514bc3223eeb9b65f5"
server_key_iv: "5b475a7b90354fd4f9b9702e4942408e"
server_key_version: "encryptionkey@0"
I20260809 00:50:49.473254 25770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:50:49.476652 25789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:49.478017 25770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:50:49.478176 25770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "2a1867bb546a444d9fea48e0c7d24911"
format_stamp: "Formatted at 2026-08-09 00:50:49 on dist-test-slave-t7g5"
server_key: "5cba25b2cd5f6a514bc3223eeb9b65f5"
server_key_iv: "5b475a7b90354fd4f9b9702e4942408e"
server_key_version: "encryptionkey@0"
I20260809 00:50:49.478359 25770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:49.512478 25770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:49.516952 25770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:49.517232 25770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:49.535816 25770 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34931
I20260809 00:50:49.535849 25863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34931 every 8 connection(s)
I20260809 00:50:49.537235 25770 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:49.541152 25864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:49.546301 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 25770
I20260809 00:50:49.546468 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:50:49.546875 29042 external_mini_cluster.cc:1428] Setting key 76900f98e775407b61e90814c1b14fdf
I20260809 00:50:49.552286 25864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911: Bootstrap starting.
I20260809 00:50:49.556209 25864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:49.557552 25864 log.cc:824] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:49.561156 25864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911: No bootstrap required, opened a new log
Aug 09 00:50:49 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:49.569367 25864 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1867bb546a444d9fea48e0c7d24911" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34931 } }
I20260809 00:50:49.569876 25864 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:49.569993 25864 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a1867bb546a444d9fea48e0c7d24911, State: Initialized, Role: FOLLOWER
I20260809 00:50:49.570698 25864 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1867bb546a444d9fea48e0c7d24911" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34931 } }
I20260809 00:50:49.571036 25864 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:49.571233 25864 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:49.571256 25868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:49.548705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37104 (local address 127.28.92.190:34931)
0809 00:50:49.549550 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:49.549562 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:49.549609 (+ 47us) server_negotiation.cc:407] Connection header received
0809 00:50:49.551410 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:49.551437 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:49.551817 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:49.552150 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:49.554089 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:49.555452 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:49.557388 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:49.558264 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:49.558459 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:49.563434 (+ 4975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:49.563443 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:49.563461 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:49.563508 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:49.566769 (+ 3261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:49.567527 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:49.567534 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:49.567540 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:49.567725 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:49.568129 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:49.568132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:49.568134 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:49.568710 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:49.568991 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:49.569464 (+ 473us) server_negotiation.cc:299] Negotiation successful
0809 00:50:49.569908 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":360,"threads_started":1}
I20260809 00:50:49.571446 25864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:49.574322 25864 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1867bb546a444d9fea48e0c7d24911" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34931 } }
I20260809 00:50:49.574807 25864 leader_election.cc:302] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a1867bb546a444d9fea48e0c7d24911; no voters:
I20260809 00:50:49.575337 25864 leader_election.cc:288] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:50:49.575467 25872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:49.576144 25872 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [term 1 LEADER]: Becoming Leader. State: Replica: 2a1867bb546a444d9fea48e0c7d24911, State: Running, Role: LEADER
I20260809 00:50:49.576710 25872 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1867bb546a444d9fea48e0c7d24911" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34931 } }
I20260809 00:50:49.577329 25864 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:49.579805 25873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a1867bb546a444d9fea48e0c7d24911" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1867bb546a444d9fea48e0c7d24911" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34931 } } }
I20260809 00:50:49.580252 25873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:49.580981 25874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a1867bb546a444d9fea48e0c7d24911. Latest consensus state: current_term: 1 leader_uuid: "2a1867bb546a444d9fea48e0c7d24911" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1867bb546a444d9fea48e0c7d24911" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34931 } } }
I20260809 00:50:49.581436 25874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:49.581681 25880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:49.586532 25880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:49.596925 25880 catalog_manager.cc:1347] Generated new cluster ID: 5e47cb6756b14619a3eecbf98d669d19
I20260809 00:50:49.597079 25880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:49.612661 25880 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:50:49.614037 25880 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:49.620301 25880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911: Generated new TSK 0
I20260809 00:50:49.621349 25880 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:50:49.690894 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34931
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:50.039713 25902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:50.040007 25902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:50.040112 25902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:50.047314 25902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:50.047436 25902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:50.047559 25902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:50.057507 25902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34931
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:50.058862 25902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:50.060141 25902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:50.073333 25912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:50.073249 25910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:50.073274 25909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:50.074136 25902 server_base.cc:1034] running on GCE node
I20260809 00:50:50.074702 25902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:50.075624 25902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:50.076810 25902 hybrid_clock.cc:648] HybridClock initialized: now 1786236650076760 us; error 45 us; skew 500 ppm
I20260809 00:50:50.077128 25902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:50 dist-test-slave-t7g5 krb5kdc[25747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236650, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:50.083508 25902 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:50:50.084961 25902 webserver.cc:460] Webserver started at http://127.28.92.129:42517/ using document root <none> and password file <none>
I20260809 00:50:50.085639 25902 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:50.085834 25902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:50.086155 25902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:50.089109 25902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "b50fb7e50a2649bc9af4eb2578059c49"
format_stamp: "Formatted at 2026-08-09 00:50:50 on dist-test-slave-t7g5"
server_key: "b8cd9f12b1a8c67f26ed7a83d1310e9c"
server_key_iv: "9f2970eae85ebae0addafa37ac28a6d7"
server_key_version: "encryptionkey@0"
I20260809 00:50:50.089897 25902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "b50fb7e50a2649bc9af4eb2578059c49"
format_stamp: "Formatted at 2026-08-09 00:50:50 on dist-test-slave-t7g5"
server_key: "b8cd9f12b1a8c67f26ed7a83d1310e9c"
server_key_iv: "9f2970eae85ebae0addafa37ac28a6d7"
server_key_version: "encryptionkey@0"
I20260809 00:50:50.094950 25902 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 00:50:50.098424 25921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:50.099769 25902 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:50:50.099943 25902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "b50fb7e50a2649bc9af4eb2578059c49"
format_stamp: "Formatted at 2026-08-09 00:50:50 on dist-test-slave-t7g5"
server_key: "b8cd9f12b1a8c67f26ed7a83d1310e9c"
server_key_iv: "9f2970eae85ebae0addafa37ac28a6d7"
server_key_version: "encryptionkey@0"
I20260809 00:50:50.100137 25902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:50.136993 25902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:50.141064 25902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:50.141372 25902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:50.142439 25902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:50.143862 25902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:50.143959 25902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:50.144088 25902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:50.144142 25902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:50.174914 25902 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:33717
I20260809 00:50:50.174969 26077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:33717 every 8 connection(s)
I20260809 00:50:50.176250 25902 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:50.185799 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 25902
I20260809 00:50:50.185977 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:50:50.186410 29042 external_mini_cluster.cc:1428] Setting key 92e7b5389b82ec550cc750a9fb1b24b6
Aug 09 00:50:50 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236650, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:50.198938 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:50.179359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34931 (local address 127.28.92.129:40531)
0809 00:50:50.180062 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:50.180104 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:50.181848 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:50.182566 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:50.182574 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:50.183089 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:50.183630 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:50.183653 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.184738 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.184742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:50.186091 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:50.186105 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.186951 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.186960 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:50.187180 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:50.187833 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:50.187862 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:50.190540 (+ 2678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:50.194308 (+ 3768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:50.194318 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:50.194335 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:50.194895 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:50.195320 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:50.195325 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:50.195328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:50.195576 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:50.196275 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:50.196283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:50.196708 (+ 425us) client_negotiation.cc:769] Sending connection context
0809 00:50:50.197007 (+ 299us) client_negotiation.cc:240] Negotiation successful
0809 00:50:50.197545 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":273,"threads_started":1}
I20260809 00:50:50.200059 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:50.178779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:40531 (local address 127.28.92.190:34931)
0809 00:50:50.179262 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:50.179267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:50.180228 (+ 961us) server_negotiation.cc:407] Connection header received
0809 00:50:50.182122 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:50.182127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:50.182213 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:50.182311 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:50.183805 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.184586 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.186224 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.186697 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.186819 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:50.190796 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:50.190803 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:50.190808 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:50.190848 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:50.194140 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:50.195046 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:50.195051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:50.195055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:50.195201 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:50.195703 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:50.195708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:50.195711 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:50.196054 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:50.196201 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:50.199460 (+ 3259us) server_negotiation.cc:299] Negotiation successful
0809 00:50:50.199701 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":215,"threads_started":1}
I20260809 00:50:50.202160 26078 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34931
I20260809 00:50:50.202553 26078 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:50.203518 26078 heartbeater.cc:511] Master 127.28.92.190:34931 requested a full tablet report, sending...
I20260809 00:50:50.205892 25814 ts_manager.cc:194] Registered new tserver with Master: b50fb7e50a2649bc9af4eb2578059c49 (127.28.92.129:33717)
I20260809 00:50:50.208024 25814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:40531
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:50:50.254319 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34931
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:50.578914 26090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:50.579195 26090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:50.579344 26090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:50.586584 26090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:50.586687 26090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:50.586802 26090 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:50.596139 26090 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34931
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:50.597316 26090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:50.598605 26090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:50.611151 26097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:50.611294 26096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:50.611202 26101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:50.612149 26090 server_base.cc:1034] running on GCE node
I20260809 00:50:50.612694 26090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:50.613556 26090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:50.614754 26090 hybrid_clock.cc:648] HybridClock initialized: now 1786236650614714 us; error 50 us; skew 500 ppm
I20260809 00:50:50.615051 26090 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:50 dist-test-slave-t7g5 krb5kdc[25747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236650, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:50.618016 26090 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:50:50.619376 26090 webserver.cc:460] Webserver started at http://127.28.92.130:34007/ using document root <none> and password file <none>
I20260809 00:50:50.620059 26090 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:50.620182 26090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:50.620491 26090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:50.623248 26090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "801f879a8b1c40e29d98edee2e879964"
format_stamp: "Formatted at 2026-08-09 00:50:50 on dist-test-slave-t7g5"
server_key: "b6ddc0ccf70d4178aeb1fd69489fd18a"
server_key_iv: "01e261feda736d18fbc9360d6ff1d273"
server_key_version: "encryptionkey@0"
I20260809 00:50:50.623973 26090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "801f879a8b1c40e29d98edee2e879964"
format_stamp: "Formatted at 2026-08-09 00:50:50 on dist-test-slave-t7g5"
server_key: "b6ddc0ccf70d4178aeb1fd69489fd18a"
server_key_iv: "01e261feda736d18fbc9360d6ff1d273"
server_key_version: "encryptionkey@0"
I20260809 00:50:50.628787 26090 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 00:50:50.632043 26109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:50.633241 26090 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 00:50:50.633389 26090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "801f879a8b1c40e29d98edee2e879964"
format_stamp: "Formatted at 2026-08-09 00:50:50 on dist-test-slave-t7g5"
server_key: "b6ddc0ccf70d4178aeb1fd69489fd18a"
server_key_iv: "01e261feda736d18fbc9360d6ff1d273"
server_key_version: "encryptionkey@0"
I20260809 00:50:50.633579 26090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:50.663218 26090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:50.667157 26090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:50.667445 26090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:50.668501 26090 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:50.669899 26090 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:50.669983 26090 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:50.670102 26090 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:50.670169 26090 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:50.700266 26090 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:45511
I20260809 00:50:50.700312 26276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:45511 every 8 connection(s)
I20260809 00:50:50.701740 26090 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:50.711601 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 26090
I20260809 00:50:50.711799 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:50:50.712261 29042 external_mini_cluster.cc:1428] Setting key 9cf7eae6dd276b52849bd74362b5fba0
Aug 09 00:50:50 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236650, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:50.722272 26283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:50.704217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:39797 (local address 127.28.92.190:34931)
0809 00:50:50.706550 (+ 2333us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:50.706555 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:50.706574 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:50:50.707684 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:50.707689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:50.707794 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:50.707913 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:50.709346 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.710216 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.711782 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.712246 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.712407 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:50.716620 (+ 4213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:50.716625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:50.716628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:50.716661 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:50.719134 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:50.719998 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:50.720001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:50.720003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:50.720133 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:50.720604 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:50.720606 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:50.720608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:50.720858 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:50.720965 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:50.721846 (+ 881us) server_negotiation.cc:299] Negotiation successful
0809 00:50:50.722012 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2235,"thread_start_us":2132,"threads_started":1}
I20260809 00:50:50.723788 26284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:50.704897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34931 (local address 127.28.92.130:39797)
0809 00:50:50.705724 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:50.705764 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:50.707393 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:50.708117 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:50.708125 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:50.708609 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:50.709164 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:50.709181 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.710342 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.710346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:50.711639 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:50.711652 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:50.712504 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:50.712512 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:50.712759 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:50.713454 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:50.713483 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:50.716386 (+ 2903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:50.719296 (+ 2910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:50.719307 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:50.719324 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:50.719894 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:50.720239 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:50.720244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:50.720247 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:50.720506 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:50.720977 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:50.720985 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:50.721433 (+ 448us) client_negotiation.cc:769] Sending connection context
0809 00:50:50.721788 (+ 355us) client_negotiation.cc:240] Negotiation successful
0809 00:50:50.722344 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":327,"threads_started":1}
I20260809 00:50:50.725240 26277 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34931
I20260809 00:50:50.725596 26277 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:50.726521 26277 heartbeater.cc:511] Master 127.28.92.190:34931 requested a full tablet report, sending...
I20260809 00:50:50.728163 25814 ts_manager.cc:194] Registered new tserver with Master: 801f879a8b1c40e29d98edee2e879964 (127.28.92.130:45511)
I20260809 00:50:50.729059 25814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:39797
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:50:50.777323 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34931
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:51.122864 26288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:51.123174 26288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:51.123283 26288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:51.130749 26288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:51.130893 26288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:51.131026 26288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:51.141352 26288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:34931
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:51.142743 26288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:51.144101 26288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:51.157963 26297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:51.157917 26295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:51.157887 26294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:51.158260 26288 server_base.cc:1034] running on GCE node
I20260809 00:50:51.159206 26288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:51.160202 26288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:51.161451 26288 hybrid_clock.cc:648] HybridClock initialized: now 1786236651161389 us; error 48 us; skew 500 ppm
I20260809 00:50:51.161840 26288 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:51 dist-test-slave-t7g5 krb5kdc[25747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236651, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:51.165045 26288 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:50:51.166620 26288 webserver.cc:460] Webserver started at http://127.28.92.131:39765/ using document root <none> and password file <none>
I20260809 00:50:51.167354 26288 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:51.167490 26288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:51.167833 26288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:51.171031 26288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "c2c8f1ba73cb47999073a37e6489df3e"
format_stamp: "Formatted at 2026-08-09 00:50:51 on dist-test-slave-t7g5"
server_key: "ceb063807aa5342356fa264fe4842b95"
server_key_iv: "e4a656faf47e16fe043284e5e435a61a"
server_key_version: "encryptionkey@0"
I20260809 00:50:51.171870 26288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "c2c8f1ba73cb47999073a37e6489df3e"
format_stamp: "Formatted at 2026-08-09 00:50:51 on dist-test-slave-t7g5"
server_key: "ceb063807aa5342356fa264fe4842b95"
server_key_iv: "e4a656faf47e16fe043284e5e435a61a"
server_key_version: "encryptionkey@0"
I20260809 00:50:51.178417 26288 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260809 00:50:51.182816 26306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:51.184087 26288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260809 00:50:51.184245 26288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "c2c8f1ba73cb47999073a37e6489df3e"
format_stamp: "Formatted at 2026-08-09 00:50:51 on dist-test-slave-t7g5"
server_key: "ceb063807aa5342356fa264fe4842b95"
server_key_iv: "e4a656faf47e16fe043284e5e435a61a"
server_key_version: "encryptionkey@0"
I20260809 00:50:51.184423 26288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:51.205408 26288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:51.209615 26288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:51.209966 26288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:51.210971 26288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:51.211102 26078 heartbeater.cc:503] Master 127.28.92.190:34931 was elected leader, sending a full tablet report...
I20260809 00:50:51.212553 26288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:51.212646 26288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:51.212785 26288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:51.212864 26288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:51.244678 26288 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:35759
I20260809 00:50:51.244720 26471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:35759 every 8 connection(s)
I20260809 00:50:51.246084 26288 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:51.256219 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 26288
I20260809 00:50:51.256446 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:50:51.256989 29042 external_mini_cluster.cc:1428] Setting key e49a49aa508f1e097cd00c65ceae01bf
Aug 09 00:50:51 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236651, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:51.264712 26474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.248662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:40299 (local address 127.28.92.190:34931)
0809 00:50:51.249075 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.249080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.250029 (+ 949us) server_negotiation.cc:407] Connection header received
0809 00:50:51.251759 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.251763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.251853 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.251985 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:51.253305 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.254122 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.255587 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.255990 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.256081 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.259851 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:51.259856 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:51.259859 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:51.259891 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:51.262275 (+ 2384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.262945 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.262949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.262951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.263063 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.263380 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.263383 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.263385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.263618 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:51.263735 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.264290 (+ 555us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.264446 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":202,"threads_started":1}
I20260809 00:50:51.265533 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.249132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:34931 (local address 127.28.92.131:40299)
0809 00:50:51.249876 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:51.249922 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:51.251526 (+ 1604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:51.252139 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:51.252146 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:51.252640 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:51.253163 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.253179 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.254241 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.254245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.255414 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.255439 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.256211 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.256219 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.256502 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.257153 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:51.257188 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:51.259653 (+ 2465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:51.262388 (+ 2735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:51.262394 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:51.262405 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:51.262853 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:51.263137 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:51.263140 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:51.263142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:51.263307 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:51.263711 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:51.263716 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:51.264003 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 00:50:51.264212 (+ 209us) client_negotiation.cc:240] Negotiation successful
0809 00:50:51.264558 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":263,"threads_started":1}
I20260809 00:50:51.266700 26472 heartbeater.cc:347] Connected to a master server at 127.28.92.190:34931
I20260809 00:50:51.266944 26472 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:51.267565 26472 heartbeater.cc:511] Master 127.28.92.190:34931 requested a full tablet report, sending...
I20260809 00:50:51.268811 25814 ts_manager.cc:194] Registered new tserver with Master: c2c8f1ba73cb47999073a37e6489df3e (127.28.92.131:35759)
I20260809 00:50:51.269577 25814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:40299
I20260809 00:50:51.271975 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:50:51.288066 26474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.275944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37110 (local address 127.28.92.190:34931)
0809 00:50:51.276091 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.276095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.276491 (+ 396us) server_negotiation.cc:407] Connection header received
0809 00:50:51.276631 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.276634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.276688 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.276756 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:51.278181 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.278872 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.280163 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.280537 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.280635 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.283197 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:51.283202 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:51.283206 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:51.283234 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:51.285475 (+ 2241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.286223 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.286227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.286229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.286345 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.286671 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.286674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.286676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.287049 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:51.287249 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.287583 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.287748 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 00:50:51.291829 25814 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:50:51.298570 25814 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:50:51.320451 26490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.310208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57604 (local address 127.28.92.131:35759)
0809 00:50:51.311799 (+ 1591us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.311807 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.311838 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:50:51.311946 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.311954 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.312207 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.312398 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:51.313728 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.315414 (+ 1686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.318335 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.319330 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.319467 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.319706 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.319953 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.320116 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1417,"thread_start_us":1270,"threads_started":1}
I20260809 00:50:51.320557 26489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.310152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:35759 (local address 127.0.0.1:57604)
0809 00:50:51.310864 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:51.310908 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:51.311085 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:51.312977 (+ 1892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:51.312984 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:51.313014 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:51.313460 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.313476 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.315574 (+ 2098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.315579 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.318157 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.318171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.319529 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.319535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.319720 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.319778 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 00:50:51.319912 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 00:50:51.320107 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":373,"thread_start_us":335,"threads_started":1}
I20260809 00:50:51.320705 26491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.311251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:33717 (local address 127.0.0.1:46108)
0809 00:50:51.311728 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:51.311742 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:51.311828 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:51.313375 (+ 1547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:51.313379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:51.313403 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:51.313854 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.313867 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.315728 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.315732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.317909 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.317928 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.319949 (+ 2021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.319956 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.320122 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.320153 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 00:50:51.320239 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 00:50:51.320353 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":133,"thread_start_us":630,"threads_started":1}
I20260809 00:50:51.321375 26493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.312491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:45511 (local address 127.0.0.1:47594)
0809 00:50:51.313054 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:51.313073 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:51.313203 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:51.314614 (+ 1411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:51.314619 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:51.314644 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:51.314977 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.314987 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.316865 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.316871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.319019 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.319035 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.320775 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.320783 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.320949 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.320980 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 00:50:51.321045 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 00:50:51.321160 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":270,"threads_started":1}
I20260809 00:50:51.321412 26492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.311821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46108 (local address 127.28.92.129:33717)
0809 00:50:51.312555 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.312564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.312593 (+ 29us) server_negotiation.cc:407] Connection header received
0809 00:50:51.312710 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.312718 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.312929 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.313127 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:51.314066 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.315608 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.318139 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.319456 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.319581 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.319796 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.320902 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.321089 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":303,"threads_started":1}
I20260809 00:50:51.322575 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.312653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47594 (local address 127.28.92.130:45511)
0809 00:50:51.314057 (+ 1404us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.314065 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.314091 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:50:51.314191 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.314198 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.314411 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.315117 (+ 706us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:51.315287 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.316715 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.319191 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.320522 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.321837 (+ 1315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.322029 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.322106 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.322255 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1274,"thread_start_us":1126,"threads_started":1}
I20260809 00:50:51.324913 26382 tablet_service.cc:1467] Processing CreateTablet for tablet f7a30510be2941aab7579444fe7e7b0a (DEFAULT_TABLE table=test-table [id=a2a06b5b44a345e3a5bf4c909e778c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:51.324913 25987 tablet_service.cc:1467] Processing CreateTablet for tablet f7a30510be2941aab7579444fe7e7b0a (DEFAULT_TABLE table=test-table [id=a2a06b5b44a345e3a5bf4c909e778c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:51.325408 26175 tablet_service.cc:1467] Processing CreateTablet for tablet f7a30510be2941aab7579444fe7e7b0a (DEFAULT_TABLE table=test-table [id=a2a06b5b44a345e3a5bf4c909e778c51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:51.326453 26382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7a30510be2941aab7579444fe7e7b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:51.326450 25987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7a30510be2941aab7579444fe7e7b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:51.326546 26175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7a30510be2941aab7579444fe7e7b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:51.338022 26499 tablet_bootstrap.cc:492] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Bootstrap starting.
I20260809 00:50:51.340449 26501 tablet_bootstrap.cc:492] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Bootstrap starting.
I20260809 00:50:51.342397 26499 tablet_bootstrap.cc:654] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:51.343252 26502 tablet_bootstrap.cc:492] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Bootstrap starting.
I20260809 00:50:51.343698 26499 log.cc:824] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:51.344552 26501 tablet_bootstrap.cc:654] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:51.345676 26501 log.cc:824] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:51.346369 26502 tablet_bootstrap.cc:654] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:51.346932 26499 tablet_bootstrap.cc:492] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: No bootstrap required, opened a new log
I20260809 00:50:51.347175 26499 ts_tablet_manager.cc:1397] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260809 00:50:51.347573 26502 log.cc:824] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:51.348685 26501 tablet_bootstrap.cc:492] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: No bootstrap required, opened a new log
I20260809 00:50:51.348953 26501 ts_tablet_manager.cc:1397] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260809 00:50:51.351624 26502 tablet_bootstrap.cc:492] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: No bootstrap required, opened a new log
I20260809 00:50:51.351960 26502 ts_tablet_manager.cc:1397] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 00:50:51.356405 26501 raft_consensus.cc:348] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.356791 26501 raft_consensus.cc:374] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:51.356886 26501 raft_consensus.cc:729] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b50fb7e50a2649bc9af4eb2578059c49, State: Initialized, Role: FOLLOWER
I20260809 00:50:51.357158 26499 raft_consensus.cc:348] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.357565 26499 raft_consensus.cc:374] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:51.357684 26499 raft_consensus.cc:729] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801f879a8b1c40e29d98edee2e879964, State: Initialized, Role: FOLLOWER
I20260809 00:50:51.357561 26501 consensus_queue.cc:260] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.358382 26499 consensus_queue.cc:260] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.359452 26501 ts_tablet_manager.cc:1428] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260809 00:50:51.362569 26502 raft_consensus.cc:348] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.362880 26502 raft_consensus.cc:374] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:51.362986 26502 raft_consensus.cc:729] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c8f1ba73cb47999073a37e6489df3e, State: Initialized, Role: FOLLOWER
I20260809 00:50:51.363507 26502 consensus_queue.cc:260] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.363708 26508 raft_consensus.cc:482] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:50:51.364094 26508 raft_consensus.cc:504] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.366135 26508 leader_election.cc:288] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2c8f1ba73cb47999073a37e6489df3e (127.28.92.131:35759), 801f879a8b1c40e29d98edee2e879964 (127.28.92.130:45511)
I20260809 00:50:51.366448 26499 ts_tablet_manager.cc:1428] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Time spent starting tablet: real 0.019s user 0.011s sys 0.008s
I20260809 00:50:51.366884 26277 heartbeater.cc:503] Master 127.28.92.190:34931 was elected leader, sending a full tablet report...
I20260809 00:50:51.366892 26502 ts_tablet_manager.cc:1428] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260809 00:50:51.367240 26472 heartbeater.cc:503] Master 127.28.92.190:34931 was elected leader, sending a full tablet report...
I20260809 00:50:51.374233 26490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.366914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:54435 (local address 127.28.92.131:35759)
0809 00:50:51.367097 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.367104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.367860 (+ 756us) server_negotiation.cc:407] Connection header received
0809 00:50:51.368153 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.368158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.368231 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.368296 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:51.369073 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.370068 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.372468 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.373328 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.373481 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.373557 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.373854 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.373985 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:50:51.374560 26518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.366511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:35759 (local address 127.28.92.129:54435)
0809 00:50:51.367757 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:51.367777 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:51.367985 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:51.368484 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:51.368487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:51.368507 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:51.368874 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.368889 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.370233 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.370241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.372319 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.372334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.373521 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.373528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.373695 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.373730 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 00:50:51.373867 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 00:50:51.373999 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":114,"thread_start_us":929,"threads_started":1}
I20260809 00:50:51.375451 26519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.367910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:45511 (local address 127.28.92.129:43709)
0809 00:50:51.369128 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:51.369147 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:51.369321 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:51.369851 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:51.369855 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:51.369878 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:51.370266 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.370282 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.371608 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.371613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.373222 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:51.373238 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.374846 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.374853 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:51.375027 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.375052 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 00:50:51.375124 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 00:50:51.375206 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1107,"mutex_wait_us":3,"thread_start_us":3345,"threads_started":1}
I20260809 00:50:51.375573 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.368270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:43709 (local address 127.28.92.130:45511)
0809 00:50:51.368459 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.368465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.369223 (+ 758us) server_negotiation.cc:407] Connection header received
0809 00:50:51.369464 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.369470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.369542 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.369602 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:51.370448 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.371466 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.373572 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.374655 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.374798 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.374857 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.375178 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.375309 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:50:51.375458 26409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a30510be2941aab7579444fe7e7b0a" candidate_uuid: "b50fb7e50a2649bc9af4eb2578059c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c8f1ba73cb47999073a37e6489df3e" is_pre_election: true
I20260809 00:50:51.376034 26409 raft_consensus.cc:2454] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b50fb7e50a2649bc9af4eb2578059c49 in term 0.
I20260809 00:50:51.376432 26200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a30510be2941aab7579444fe7e7b0a" candidate_uuid: "b50fb7e50a2649bc9af4eb2578059c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f879a8b1c40e29d98edee2e879964" is_pre_election: true
I20260809 00:50:51.376605 25923 leader_election.cc:302] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b50fb7e50a2649bc9af4eb2578059c49, c2c8f1ba73cb47999073a37e6489df3e; no voters:
I20260809 00:50:51.376858 26200 raft_consensus.cc:2454] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b50fb7e50a2649bc9af4eb2578059c49 in term 0.
I20260809 00:50:51.376973 26508 raft_consensus.cc:2781] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:50:51.377141 26508 raft_consensus.cc:482] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:50:51.377257 26508 raft_consensus.cc:3037] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:51.379547 26508 raft_consensus.cc:504] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.380100 26508 leader_election.cc:288] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [CANDIDATE]: Term 1 election: Requested vote from peers c2c8f1ba73cb47999073a37e6489df3e (127.28.92.131:35759), 801f879a8b1c40e29d98edee2e879964 (127.28.92.130:45511)
I20260809 00:50:51.380438 26409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a30510be2941aab7579444fe7e7b0a" candidate_uuid: "b50fb7e50a2649bc9af4eb2578059c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c8f1ba73cb47999073a37e6489df3e"
I20260809 00:50:51.380574 26200 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a30510be2941aab7579444fe7e7b0a" candidate_uuid: "b50fb7e50a2649bc9af4eb2578059c49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "801f879a8b1c40e29d98edee2e879964"
I20260809 00:50:51.380642 26409 raft_consensus.cc:3037] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:51.380770 26200 raft_consensus.cc:3037] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:51.383798 26409 raft_consensus.cc:2454] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b50fb7e50a2649bc9af4eb2578059c49 in term 1.
I20260809 00:50:51.383798 26200 raft_consensus.cc:2454] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b50fb7e50a2649bc9af4eb2578059c49 in term 1.
I20260809 00:50:51.384150 25923 leader_election.cc:302] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b50fb7e50a2649bc9af4eb2578059c49, c2c8f1ba73cb47999073a37e6489df3e; no voters:
I20260809 00:50:51.384379 26508 raft_consensus.cc:2781] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:51.384774 26508 raft_consensus.cc:686] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 1 LEADER]: Becoming Leader. State: Replica: b50fb7e50a2649bc9af4eb2578059c49, State: Running, Role: LEADER
I20260809 00:50:51.385188 26508 consensus_queue.cc:237] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } }
I20260809 00:50:51.390092 25813 catalog_manager.cc:5495] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 reported cstate change: term changed from 0 to 1, leader changed from <none> to b50fb7e50a2649bc9af4eb2578059c49 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "b50fb7e50a2649bc9af4eb2578059c49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b50fb7e50a2649bc9af4eb2578059c49" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 33717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260809 00:50:51.421471 26492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.416114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.28.92.129:33717)
0809 00:50:51.416329 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.416335 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.416372 (+ 37us) server_negotiation.cc:407] Connection header received
0809 00:50:51.416472 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.416477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.416554 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.416681 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:51.417104 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.417874 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.419278 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.419681 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.419793 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.420378 (+ 585us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:51.420883 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:50:51.421048 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.421201 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.421248 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 00:50:51.428537 26079 tablet.cc:2369] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:50:51.429369 26409 raft_consensus.cc:1261] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 1 FOLLOWER]: Refusing update from remote peer b50fb7e50a2649bc9af4eb2578059c49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:51.429474 26200 raft_consensus.cc:1261] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 1 FOLLOWER]: Refusing update from remote peer b50fb7e50a2649bc9af4eb2578059c49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:51.430274 26522 consensus_queue.cc:1035] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c8f1ba73cb47999073a37e6489df3e" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 35759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:51.430635 26508 consensus_queue.cc:1035] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "801f879a8b1c40e29d98edee2e879964" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:51.442245 26529 mvcc.cc:205] Tried to move back new op lower bound from 7316425324244697088 to 7316425324077445120. Current Snapshot: MvccSnapshot[applied={T|T < 7316425324244697088}]
I20260809 00:50:51.453455 25814 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:51.453742 25814 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:51.457053 25814 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2a1867bb546a444d9fea48e0c7d24911: Sending DeleteTablet for 3 replicas of tablet f7a30510be2941aab7579444fe7e7b0a
I20260809 00:50:51.458073 26382 tablet_service.cc:1514] Processing DeleteTablet for tablet f7a30510be2941aab7579444fe7e7b0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:51 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:57604
I20260809 00:50:51.458300 26175 tablet_service.cc:1514] Processing DeleteTablet for tablet f7a30510be2941aab7579444fe7e7b0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:51 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:47594
I20260809 00:50:51.458379 25987 tablet_service.cc:1514] Processing DeleteTablet for tablet f7a30510be2941aab7579444fe7e7b0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:51 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:46108
I20260809 00:50:51.460381 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 25902
I20260809 00:50:51.466156 26545 tablet_replica.cc:330] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: stopping tablet replica
I20260809 00:50:51.466642 26545 raft_consensus.cc:2229] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:50:51.467438 26545 raft_consensus.cc:2258] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:51.469736 26545 ts_tablet_manager.cc:1905] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:51.477610 26544 tablet_replica.cc:330] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: stopping tablet replica
I20260809 00:50:51.478102 26544 raft_consensus.cc:2229] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:51.478770 26544 raft_consensus.cc:2258] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:51.478926 26545 ts_tablet_manager.cc:1918] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:51.479152 26545 log.cc:1196] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/f7a30510be2941aab7579444fe7e7b0a
I20260809 00:50:51.479280 26543 tablet_replica.cc:330] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: stopping tablet replica
I20260809 00:50:51.479753 26543 raft_consensus.cc:2229] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:51.480463 26545 ts_tablet_manager.cc:1939] T f7a30510be2941aab7579444fe7e7b0a P b50fb7e50a2649bc9af4eb2578059c49: Deleting consensus metadata
I20260809 00:50:51.480949 26543 raft_consensus.cc:2258] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:51.481092 26544 ts_tablet_manager.cc:1905] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 00:50:51 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:50:51.483570 25795 catalog_manager.cc:4841] TS b50fb7e50a2649bc9af4eb2578059c49 (127.28.92.129:33717): tablet f7a30510be2941aab7579444fe7e7b0a (table test-table [id=a2a06b5b44a345e3a5bf4c909e778c51]) successfully deleted
I20260809 00:50:51.488251 26544 ts_tablet_manager.cc:1918] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:51.488433 26544 log.cc:1196] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/f7a30510be2941aab7579444fe7e7b0a
I20260809 00:50:51.488979 26544 ts_tablet_manager.cc:1939] T f7a30510be2941aab7579444fe7e7b0a P 801f879a8b1c40e29d98edee2e879964: Deleting consensus metadata
I20260809 00:50:51.489156 26543 ts_tablet_manager.cc:1905] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:51.490798 25795 catalog_manager.cc:4841] TS 801f879a8b1c40e29d98edee2e879964 (127.28.92.130:45511): tablet f7a30510be2941aab7579444fe7e7b0a (table test-table [id=a2a06b5b44a345e3a5bf4c909e778c51]) successfully deleted
I20260809 00:50:51.492060 26492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.462985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46134 (local address 127.28.92.129:33717)
0809 00:50:51.463172 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.463179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.466959 (+ 3780us) server_negotiation.cc:407] Connection header received
0809 00:50:51.467826 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.467833 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.467914 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.468029 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:51.471425 (+ 3396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.472662 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.476169 (+ 3507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.476872 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.476975 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.483690 (+ 6715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:51.483706 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:51.483725 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:51.483766 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:51.487856 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.489158 (+ 1302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.489169 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.489172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.489404 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.489937 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.489943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.489946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.490406 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:51.490704 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.491434 (+ 730us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.491696 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:50:51.492758 26070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:51.495687 26543 ts_tablet_manager.cc:1918] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:51.495865 26543 log.cc:1196] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/f7a30510be2941aab7579444fe7e7b0a
I20260809 00:50:51.496409 26543 ts_tablet_manager.cc:1939] T f7a30510be2941aab7579444fe7e7b0a P c2c8f1ba73cb47999073a37e6489df3e: Deleting consensus metadata
I20260809 00:50:51.497965 25795 catalog_manager.cc:4841] TS c2c8f1ba73cb47999073a37e6489df3e (127.28.92.131:35759): tablet f7a30510be2941aab7579444fe7e7b0a (table test-table [id=a2a06b5b44a345e3a5bf4c909e778c51]) successfully deleted
I20260809 00:50:51.598292 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 25902
I20260809 00:50:51.622651 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 26090
Aug 09 00:50:51 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:50:51.636571 26496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.623465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47598 (local address 127.28.92.130:45511)
0809 00:50:51.623628 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.623633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.623651 (+ 18us) server_negotiation.cc:407] Connection header received
0809 00:50:51.623707 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.623711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.623774 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.623863 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:51.625093 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.625885 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.627068 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.627449 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.627537 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.631623 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:51.631636 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:51.631652 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:51.631685 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:51.634176 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.634808 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.634815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.634817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.634951 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.635274 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.635277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.635279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.635659 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:51.635878 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.636076 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.636237 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:50:51.637243 26270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:51.724350 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 26090
I20260809 00:50:51.746431 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 26288
Aug 09 00:50:51 dist-test-slave-t7g5 krb5kdc[25747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:50:51.760974 26490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:51.747201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.28.92.131:35759)
0809 00:50:51.747358 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:51.747362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:51.747452 (+ 90us) server_negotiation.cc:407] Connection header received
0809 00:50:51.747603 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:51.747607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:51.747670 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:51.747753 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:51.749069 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.749840 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.751131 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:51.751496 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:51.751583 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:51.756020 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:51.756037 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:51.756054 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:51.756092 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:51.758677 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.759300 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.759307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.759310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.759434 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:51.759700 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:51.759703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:51.759705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:51.760075 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:51.760289 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:51.760532 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 00:50:51.760699 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 00:50:51.761615 26467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:51.849402 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 26288
I20260809 00:50:51.872990 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 25770
I20260809 00:50:51.874238 25857 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:51.985683 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 25770
2026-08-09T00:50:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4425 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T00:50:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:50:52Z Disabled control of system clock
I20260809 00:50:52.078379 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:45165
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:45165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 00:50:52.424499 26558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:52.424799 26558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:52.424929 26558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:52.432238 26558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:52.432344 26558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:52.432389 26558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:52.432471 26558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:52.432529 26558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:52.441699 26558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:45165
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:45165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:52.443017 26558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:52.444854 26558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:52.456442 26564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:52.456545 26565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:52.456624 26567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:52.457499 26558 server_base.cc:1034] running on GCE node
I20260809 00:50:52.458354 26558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:52.459807 26558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:52.461018 26558 hybrid_clock.cc:648] HybridClock initialized: now 1786236652460967 us; error 43 us; skew 500 ppm
I20260809 00:50:52.461364 26558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:52.463714 26558 webserver.cc:460] Webserver started at http://127.28.92.190:37257/ using document root <none> and password file <none>
I20260809 00:50:52.464417 26558 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:52.464529 26558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:52.464851 26558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:52.467854 26558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "229ae79ddc3a4b19bf9534f428ecbc4c"
format_stamp: "Formatted at 2026-08-09 00:50:52 on dist-test-slave-t7g5"
server_key: "c116e23270cf092d094c907fc03724f6"
server_key_iv: "89a12377083dea9f27c8ebb911c91d65"
server_key_version: "encryptionkey@0"
I20260809 00:50:52.468659 26558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "229ae79ddc3a4b19bf9534f428ecbc4c"
format_stamp: "Formatted at 2026-08-09 00:50:52 on dist-test-slave-t7g5"
server_key: "c116e23270cf092d094c907fc03724f6"
server_key_iv: "89a12377083dea9f27c8ebb911c91d65"
server_key_version: "encryptionkey@0"
I20260809 00:50:52.474011 26558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:50:52.477504 26574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:52.478863 26558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:50:52.479058 26558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "229ae79ddc3a4b19bf9534f428ecbc4c"
format_stamp: "Formatted at 2026-08-09 00:50:52 on dist-test-slave-t7g5"
server_key: "c116e23270cf092d094c907fc03724f6"
server_key_iv: "89a12377083dea9f27c8ebb911c91d65"
server_key_version: "encryptionkey@0"
I20260809 00:50:52.479269 26558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:52.490950 26558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:52.491766 26558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:52.492049 26558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:52.510452 26558 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:45165
I20260809 00:50:52.510488 26645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:45165 every 8 connection(s)
I20260809 00:50:52.511818 26558 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:52.515673 26646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:52.516965 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 26558
I20260809 00:50:52.517167 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:50:52.517841 29042 external_mini_cluster.cc:1428] Setting key eb3cc8185ae523072366ba55ea1d0edc
I20260809 00:50:52.529042 26646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c: Bootstrap starting.
I20260809 00:50:52.531369 26653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:52.519937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58060 (local address 127.28.92.190:45165)
0809 00:50:52.521026 (+ 1089us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:52.521037 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:52.521083 (+ 46us) server_negotiation.cc:407] Connection header received
0809 00:50:52.522719 (+ 1636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:52.522744 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:52.523240 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:52.523619 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:52.524199 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:52.525467 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:52.526928 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:52.527625 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:52.527809 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:52.528976 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:52.528984 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:52.528999 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:52.529578 (+ 579us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:52.529688 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:52.529717 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:52.529820 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:52.530068 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 00:50:52.530379 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":371,"threads_started":1}
I20260809 00:50:52.532430 26646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:52.533536 26646 log.cc:824] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:52.536396 26646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c: No bootstrap required, opened a new log
I20260809 00:50:52.544039 26646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45165 } }
I20260809 00:50:52.544518 26646 raft_consensus.cc:374] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:52.544629 26646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229ae79ddc3a4b19bf9534f428ecbc4c, State: Initialized, Role: FOLLOWER
I20260809 00:50:52.545202 26646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45165 } }
I20260809 00:50:52.545463 26646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:52.545595 26646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:52.545773 26646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:52.548003 26646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45165 } }
I20260809 00:50:52.548545 26646 leader_election.cc:302] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 229ae79ddc3a4b19bf9534f428ecbc4c; no voters:
I20260809 00:50:52.549118 26646 leader_election.cc:288] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:50:52.549239 26656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:52.549950 26656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [term 1 LEADER]: Becoming Leader. State: Replica: 229ae79ddc3a4b19bf9534f428ecbc4c, State: Running, Role: LEADER
I20260809 00:50:52.550469 26656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45165 } }
I20260809 00:50:52.551224 26646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:52.553023 26657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45165 } } }
I20260809 00:50:52.553447 26657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:52.553507 26658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 229ae79ddc3a4b19bf9534f428ecbc4c. Latest consensus state: current_term: 1 leader_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229ae79ddc3a4b19bf9534f428ecbc4c" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 45165 } } }
I20260809 00:50:52.553822 26658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:52.555246 26661 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:52.560253 26661 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:52.569046 26661 catalog_manager.cc:1347] Generated new cluster ID: c81d253a29a1439f80aa7a2fd90c0c25
I20260809 00:50:52.569164 26661 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:52.613426 26661 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:50:52.615446 26661 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:52.625767 26661 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c: Generated new TSK 0
I20260809 00:50:52.626742 26661 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:50:52.633975 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45165
--builtin_ntp_servers=127.28.92.148:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 00:50:52.973866 26682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:52.974148 26682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:52.974275 26682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:52.981384 26682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:52.981494 26682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:52.981638 26682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:52.990629 26682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:52.991874 26682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:52.993638 26682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:53.006717 26690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:53.006816 26689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:53.006790 26693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:53.007391 26682 server_base.cc:1034] running on GCE node
I20260809 00:50:53.008026 26682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:53.008984 26682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:53.010224 26682 hybrid_clock.cc:648] HybridClock initialized: now 1786236653010164 us; error 48 us; skew 500 ppm
I20260809 00:50:53.010574 26682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:53.012796 26682 webserver.cc:460] Webserver started at http://127.28.92.129:38081/ using document root <none> and password file <none>
I20260809 00:50:53.013509 26682 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:53.013617 26682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:53.013954 26682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:53.016932 26682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "6b6b713b5f1b4dd79a86138ee38b4151"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "b4a8163550c594cc1edd0a8b418a1a26"
server_key_iv: "17fb822ab3e64a79bc681a0d9989d26a"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.017779 26682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "6b6b713b5f1b4dd79a86138ee38b4151"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "b4a8163550c594cc1edd0a8b418a1a26"
server_key_iv: "17fb822ab3e64a79bc681a0d9989d26a"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.022874 26682 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 00:50:53.026293 26702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.027560 26682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:50:53.027719 26682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "6b6b713b5f1b4dd79a86138ee38b4151"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "b4a8163550c594cc1edd0a8b418a1a26"
server_key_iv: "17fb822ab3e64a79bc681a0d9989d26a"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.027920 26682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:53.042157 26682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:53.042961 26682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:53.043287 26682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:53.044271 26682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:53.045766 26682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:53.045866 26682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.045980 26682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:53.046052 26682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.076946 26682 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:45843
I20260809 00:50:53.076998 26858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:45843 every 8 connection(s)
I20260809 00:50:53.078394 26682 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:53.085188 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 26682
I20260809 00:50:53.085337 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:50:53.085804 29042 external_mini_cluster.cc:1428] Setting key 9e823c1f7aefbee634f720a16ba0300c
I20260809 00:50:53.088593 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45165
--builtin_ntp_servers=127.28.92.148:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 00:50:53.090866 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:53.080891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:36381 (local address 127.28.92.190:45165)
0809 00:50:53.081313 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:53.081318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:53.082419 (+ 1101us) server_negotiation.cc:407] Connection header received
0809 00:50:53.084240 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:53.084247 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:53.084339 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:53.084434 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:53.085486 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.086301 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.088191 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.088584 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.088681 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:53.090158 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:53.090164 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:53.090167 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:53.090184 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:53.090225 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:53.090237 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:53.090303 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:53.090527 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 00:50:53.090607 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":215,"threads_started":1}
I20260809 00:50:53.092070 26862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:53.081352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:45165 (local address 127.28.92.129:36381)
0809 00:50:53.082262 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:53.082304 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:53.083987 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:53.084673 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:53.084680 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:53.084762 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:53.085319 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:53.085350 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.086465 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.086470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:53.088031 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:53.088047 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.088819 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.088828 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:53.089089 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:53.089818 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:50:53.089821 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:53.089872 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:50:53.089976 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:53.090318 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:53.090330 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:53.090338 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 00:50:53.090519 (+ 181us) client_negotiation.cc:240] Negotiation successful
0809 00:50:53.090878 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":294,"threads_started":1}
I20260809 00:50:53.093537 26859 heartbeater.cc:347] Connected to a master server at 127.28.92.190:45165
I20260809 00:50:53.093858 26859 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:53.094717 26859 heartbeater.cc:511] Master 127.28.92.190:45165 requested a full tablet report, sending...
I20260809 00:50:53.096956 26597 ts_manager.cc:194] Registered new tserver with Master: 6b6b713b5f1b4dd79a86138ee38b4151 (127.28.92.129:45843)
I20260809 00:50:53.098852 26597 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.129:36381
W20260809 00:50:53.425541 26864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:53.425925 26864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:53.426069 26864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:53.433323 26864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:53.433427 26864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:53.433585 26864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:53.442665 26864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:53.443946 26864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:53.445703 26864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:53.458117 26878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:53.458158 26881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:53.458199 26879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:53.459455 26864 server_base.cc:1034] running on GCE node
I20260809 00:50:53.460045 26864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:53.460879 26864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:53.462067 26864 hybrid_clock.cc:648] HybridClock initialized: now 1786236653462027 us; error 32 us; skew 500 ppm
I20260809 00:50:53.462371 26864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:53.464391 26864 webserver.cc:460] Webserver started at http://127.28.92.130:45037/ using document root <none> and password file <none>
I20260809 00:50:53.465075 26864 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:53.465171 26864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:53.465492 26864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:53.468253 26864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "8653fdd7892b498db126f3e9cce65599"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "770f8b760da7e44b1f8164929d1897ab"
server_key_iv: "8b0280b5eff4d1798d82acd34dea7865"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.469012 26864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "8653fdd7892b498db126f3e9cce65599"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "770f8b760da7e44b1f8164929d1897ab"
server_key_iv: "8b0280b5eff4d1798d82acd34dea7865"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.473914 26864 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:50:53.477195 26889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.478495 26864 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:50:53.478646 26864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "8653fdd7892b498db126f3e9cce65599"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "770f8b760da7e44b1f8164929d1897ab"
server_key_iv: "8b0280b5eff4d1798d82acd34dea7865"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.478850 26864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:53.500715 26864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:53.501582 26864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:53.501917 26864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:53.502929 26864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:53.504529 26864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:53.504630 26864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.504743 26864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:53.504812 26864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.540222 26864 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:39917
I20260809 00:50:53.540310 27040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:39917 every 8 connection(s)
I20260809 00:50:53.541507 26864 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:53.548929 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 26864
I20260809 00:50:53.549095 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:50:53.549516 29042 external_mini_cluster.cc:1428] Setting key 5d25a15c278dce6135ab4eb8b732bd81
I20260809 00:50:53.552378 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45165
--builtin_ntp_servers=127.28.92.148:42325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 00:50:53.553900 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:53.544133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:60903 (local address 127.28.92.190:45165)
0809 00:50:53.544363 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:53.544369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:53.545701 (+ 1332us) server_negotiation.cc:407] Connection header received
0809 00:50:53.547470 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:53.547476 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:53.547555 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:53.547643 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:53.548699 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.549472 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.551170 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.551677 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.551809 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:53.553109 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:53.553114 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:53.553119 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:53.553142 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:53.553183 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:53.553198 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:53.553297 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:53.553475 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 00:50:53.553573 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 00:50:53.555032 27043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:53.544639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:45165 (local address 127.28.92.130:60903)
0809 00:50:53.545525 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:53.545564 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:53.547213 (+ 1649us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:53.547880 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:53.547888 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:53.547976 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:53.548534 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:53.548551 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.549631 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.549635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:53.551014 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:53.551027 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:53.551886 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:53.551891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:53.552113 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:53.552795 (+ 682us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:50:53.552798 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:53.552835 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:50:53.552916 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:53.553293 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:53.553298 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:53.553303 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:50:53.553459 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 00:50:53.553787 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":286,"threads_started":1}
I20260809 00:50:53.556253 27041 heartbeater.cc:347] Connected to a master server at 127.28.92.190:45165
I20260809 00:50:53.556564 27041 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:53.557385 27041 heartbeater.cc:511] Master 127.28.92.190:45165 requested a full tablet report, sending...
I20260809 00:50:53.558826 26597 ts_manager.cc:194] Registered new tserver with Master: 8653fdd7892b498db126f3e9cce65599 (127.28.92.130:39917)
I20260809 00:50:53.559633 26597 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.130:60903
W20260809 00:50:53.883667 27045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:53.883982 27045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:53.884080 27045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:53.891619 27045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:53.891721 27045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:53.891860 27045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:53.901672 27045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:42325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:45165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:53.903007 27045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:53.904832 27045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:53.917819 27051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:53.917780 27054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:53.917786 27059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:53.918581 27045 server_base.cc:1034] running on GCE node
I20260809 00:50:53.919164 27045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:53.920224 27045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:53.921432 27045 hybrid_clock.cc:648] HybridClock initialized: now 1786236653921377 us; error 49 us; skew 500 ppm
I20260809 00:50:53.921778 27045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:53.924078 27045 webserver.cc:460] Webserver started at http://127.28.92.131:33709/ using document root <none> and password file <none>
I20260809 00:50:53.924794 27045 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:53.924894 27045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:53.925233 27045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:53.928133 27045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "b4e1500856be460cb0e7670f3cb41b21"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "71d91aa8a05cf5af2e6a5e0b4ddca637"
server_key_iv: "644c97fdbee1f8ad2439d3cee932d959"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.928943 27045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "b4e1500856be460cb0e7670f3cb41b21"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "71d91aa8a05cf5af2e6a5e0b4ddca637"
server_key_iv: "644c97fdbee1f8ad2439d3cee932d959"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.934222 27045 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:50:53.937770 27070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.939095 27045 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:50:53.939258 27045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "b4e1500856be460cb0e7670f3cb41b21"
format_stamp: "Formatted at 2026-08-09 00:50:53 on dist-test-slave-t7g5"
server_key: "71d91aa8a05cf5af2e6a5e0b4ddca637"
server_key_iv: "644c97fdbee1f8ad2439d3cee932d959"
server_key_version: "encryptionkey@0"
I20260809 00:50:53.939479 27045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:53.958957 27045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:53.959811 27045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:53.960108 27045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:53.961095 27045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:53.962726 27045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:53.962826 27045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.962936 27045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:53.963006 27045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:53.992969 27045 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:34951
I20260809 00:50:53.993003 27226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:34951 every 8 connection(s)
I20260809 00:50:53.994277 27045 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:54.002381 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 27045
I20260809 00:50:54.002578 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:50:54.003022 29042 external_mini_cluster.cc:1428] Setting key 5bf330828a76df850440742167f68c1d
I20260809 00:50:54.006790 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:53.996806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:52037 (local address 127.28.92.190:45165)
0809 00:50:53.996988 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:53.996993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:53.998430 (+ 1437us) server_negotiation.cc:407] Connection header received
0809 00:50:54.000191 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.000196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.000278 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.000368 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:54.001420 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.002326 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.004159 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.004558 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.004671 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.006011 (+ 1340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:54.006016 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:54.006019 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:54.006036 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:54.006068 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:54.006080 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:54.006154 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.006360 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.006468 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:50:54.007699 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:53.997312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:45165 (local address 127.28.92.131:52037)
0809 00:50:53.998282 (+ 970us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:53.998328 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:53.999916 (+ 1588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:54.000602 (+ 686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:54.000610 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:54.000692 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:54.001252 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.001269 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.002604 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.002610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.004020 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.004036 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.004781 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.004789 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.005009 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.005709 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:50:54.005712 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:54.005751 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:50:54.005837 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:54.006166 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:54.006178 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:54.006186 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 00:50:54.006349 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 00:50:54.006725 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":303,"threads_started":1}
I20260809 00:50:54.008805 27230 heartbeater.cc:347] Connected to a master server at 127.28.92.190:45165
I20260809 00:50:54.009093 27230 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:54.009860 27230 heartbeater.cc:511] Master 127.28.92.190:45165 requested a full tablet report, sending...
I20260809 00:50:54.011220 26597 ts_manager.cc:194] Registered new tserver with Master: b4e1500856be460cb0e7670f3cb41b21 (127.28.92.131:34951)
I20260809 00:50:54.012020 26597 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.131:52037
I20260809 00:50:54.017892 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:50:54.027235 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.021905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54410 (local address 127.28.92.190:45165)
0809 00:50:54.022111 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.022119 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.022442 (+ 323us) server_negotiation.cc:407] Connection header received
0809 00:50:54.022568 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.022572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.022633 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.022709 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:54.023104 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.023784 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.025099 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.025500 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.025583 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.026584 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:54.026589 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:54.026591 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:54.026609 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:54.026639 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:54.026650 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:54.026757 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.026893 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.026950 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:50:54.030855 26597 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54410:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:50:54.037807 26597 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:50:54.060029 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.050184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.28.92.130:39917)
0809 00:50:54.051959 (+ 1775us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.051969 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.052001 (+ 32us) server_negotiation.cc:407] Connection header received
0809 00:50:54.052098 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.052105 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.052359 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.053264 (+ 905us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:54.053583 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.054963 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.057402 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.058867 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.059054 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.059328 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.059512 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.059679 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1611,"thread_start_us":1490,"threads_started":1}
I20260809 00:50:54.060070 27247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.049948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:39917 (local address 127.0.0.1:55438)
0809 00:50:54.050841 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:54.050881 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:54.051050 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:54.052654 (+ 1604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:54.052661 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:54.052709 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:54.053060 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.053074 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.055090 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.055094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.057152 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.057168 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.059099 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.059105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.059289 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.059337 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 00:50:54.059467 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 00:50:54.059668 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"mutex_wait_us":1,"spinlock_wait_cycles":5376,"thread_start_us":1047,"threads_started":1}
I20260809 00:50:54.061172 27251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.051778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:45843 (local address 127.0.0.1:59048)
0809 00:50:54.052543 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:54.052559 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:54.052706 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:54.053879 (+ 1173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:54.053888 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:54.053911 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:54.054310 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.054323 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.056219 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.056223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.058240 (+ 2017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.058253 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.060361 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.060368 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.060572 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.060605 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 00:50:54.060685 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 00:50:54.060805 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"mutex_wait_us":68,"spinlock_wait_cycles":384,"thread_start_us":464,"threads_started":1}
I20260809 00:50:54.061411 27250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.051002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59856 (local address 127.28.92.131:34951)
0809 00:50:54.052925 (+ 1923us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.052933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.052960 (+ 27us) server_negotiation.cc:407] Connection header received
0809 00:50:54.053039 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.053046 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.053224 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.054136 (+ 912us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:54.054402 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.055949 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.058674 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.060063 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.060187 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.060441 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.060887 (+ 446us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.061053 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1744,"thread_start_us":950,"threads_started":1}
I20260809 00:50:54.062110 27252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.052263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59048 (local address 127.28.92.129:45843)
0809 00:50:54.052791 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.052798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.052828 (+ 30us) server_negotiation.cc:407] Connection header received
0809 00:50:54.052926 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.052934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.053182 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.053397 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:54.054674 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.056086 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.058431 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.059863 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.059992 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.061556 (+ 1564us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.061632 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.061821 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":258,"threads_started":1}
I20260809 00:50:54.061235 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.050668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:34951 (local address 127.0.0.1:59856)
0809 00:50:54.051620 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:54.051636 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:54.051737 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:54.053416 (+ 1679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:54.053421 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:54.053445 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:54.053903 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.053915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.056098 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.056104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.058487 (+ 2383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.058504 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.060553 (+ 2049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.060559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.060715 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.060745 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 00:50:54.060817 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 00:50:54.060940 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"mutex_wait_us":115,"thread_start_us":701,"threads_started":1}
I20260809 00:50:54.064234 26957 tablet_service.cc:1467] Processing CreateTablet for tablet bdbf8fcb85104471849575c4a00a3ced (DEFAULT_TABLE table=test-table [id=63f1a33dcfa04795a7f7b959641a4856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:54.065797 26957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdbf8fcb85104471849575c4a00a3ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:54.065527 26762 tablet_service.cc:1467] Processing CreateTablet for tablet bdbf8fcb85104471849575c4a00a3ced (DEFAULT_TABLE table=test-table [id=63f1a33dcfa04795a7f7b959641a4856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:54.065953 27138 tablet_service.cc:1467] Processing CreateTablet for tablet bdbf8fcb85104471849575c4a00a3ced (DEFAULT_TABLE table=test-table [id=63f1a33dcfa04795a7f7b959641a4856]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:54.066833 26762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdbf8fcb85104471849575c4a00a3ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:54.067322 27138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdbf8fcb85104471849575c4a00a3ced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:54.084873 27253 tablet_bootstrap.cc:492] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Bootstrap starting.
I20260809 00:50:54.086207 27254 tablet_bootstrap.cc:492] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Bootstrap starting.
I20260809 00:50:54.088704 27253 tablet_bootstrap.cc:654] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:54.089967 27254 tablet_bootstrap.cc:654] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:54.090054 27253 log.cc:824] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:54.091212 27254 log.cc:824] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:54.091709 27256 tablet_bootstrap.cc:492] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Bootstrap starting.
I20260809 00:50:54.095073 27254 tablet_bootstrap.cc:492] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: No bootstrap required, opened a new log
I20260809 00:50:54.095329 27254 ts_tablet_manager.cc:1397] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 00:50:54.095439 27256 tablet_bootstrap.cc:654] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:54.095860 27253 tablet_bootstrap.cc:492] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: No bootstrap required, opened a new log
I20260809 00:50:54.096127 27253 ts_tablet_manager.cc:1397] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260809 00:50:54.096645 27256 log.cc:824] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:54.099584 27256 tablet_bootstrap.cc:492] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: No bootstrap required, opened a new log
I20260809 00:50:54.100148 27256 ts_tablet_manager.cc:1397] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 00:50:54.102146 26859 heartbeater.cc:503] Master 127.28.92.190:45165 was elected leader, sending a full tablet report...
I20260809 00:50:54.103549 27254 raft_consensus.cc:348] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.103994 27254 raft_consensus.cc:374] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:54.104099 27254 raft_consensus.cc:729] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8653fdd7892b498db126f3e9cce65599, State: Initialized, Role: FOLLOWER
I20260809 00:50:54.104672 27254 consensus_queue.cc:260] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.106210 27254 ts_tablet_manager.cc:1428] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260809 00:50:54.106495 27041 heartbeater.cc:503] Master 127.28.92.190:45165 was elected leader, sending a full tablet report...
I20260809 00:50:54.106110 27253 raft_consensus.cc:348] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.106805 27253 raft_consensus.cc:374] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:54.106920 27253 raft_consensus.cc:729] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b6b713b5f1b4dd79a86138ee38b4151, State: Initialized, Role: FOLLOWER
I20260809 00:50:54.107512 27253 consensus_queue.cc:260] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.109270 27253 ts_tablet_manager.cc:1428] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Time spent starting tablet: real 0.013s user 0.012s sys 0.002s
I20260809 00:50:54.115259 27256 raft_consensus.cc:348] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.115672 27256 raft_consensus.cc:374] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:54.115779 27256 raft_consensus.cc:729] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4e1500856be460cb0e7670f3cb41b21, State: Initialized, Role: FOLLOWER
I20260809 00:50:54.116353 27256 consensus_queue.cc:260] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.117369 27230 heartbeater.cc:503] Master 127.28.92.190:45165 was elected leader, sending a full tablet report...
I20260809 00:50:54.117960 27256 ts_tablet_manager.cc:1428] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Time spent starting tablet: real 0.018s user 0.012s sys 0.000s
I20260809 00:50:54.129952 27264 raft_consensus.cc:482] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:50:54.130370 27264 raft_consensus.cc:504] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.132091 27264 leader_election.cc:288] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8653fdd7892b498db126f3e9cce65599 (127.28.92.130:39917), b4e1500856be460cb0e7670f3cb41b21 (127.28.92.131:34951)
I20260809 00:50:54.138908 27250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.132545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:47433 (local address 127.28.92.131:34951)
0809 00:50:54.132719 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.132725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.133582 (+ 857us) server_negotiation.cc:407] Connection header received
0809 00:50:54.133794 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.133798 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.133858 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.133935 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:54.134563 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.135311 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.137208 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.138025 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.138173 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.138243 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.138516 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.138644 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:50:54.138918 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.132402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:59137 (local address 127.28.92.130:39917)
0809 00:50:54.132613 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.132619 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.133499 (+ 880us) server_negotiation.cc:407] Connection header received
0809 00:50:54.133719 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.133724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.133801 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.133877 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:54.134518 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.135214 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.137231 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.138054 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.138192 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.138263 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.138537 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.138660 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 00:50:54.139119 27268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.132554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:34951 (local address 127.28.92.129:47433)
0809 00:50:54.133491 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:54.133505 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:54.133613 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:54.133963 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:54.133967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:54.133990 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:54.134396 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.134406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.135447 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.135450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.137006 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.137019 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.138199 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.138207 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.138366 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.138390 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:50:54.138471 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 00:50:54.138647 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":42,"thread_start_us":607,"threads_started":1}
I20260809 00:50:54.139387 27267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.132502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:39917 (local address 127.28.92.129:59137)
0809 00:50:54.133386 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:54.133401 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:54.133564 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:54.133916 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:54.133920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:54.133944 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:54.134362 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.134372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.135339 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.135345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.137009 (+ 1664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:54.137022 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.138240 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.138247 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:54.138382 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.138404 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 00:50:54.138492 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 00:50:54.138639 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":80,"thread_start_us":442,"threads_started":1}
I20260809 00:50:54.140121 27166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf8fcb85104471849575c4a00a3ced" candidate_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4e1500856be460cb0e7670f3cb41b21" is_pre_election: true
I20260809 00:50:54.140388 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf8fcb85104471849575c4a00a3ced" candidate_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8653fdd7892b498db126f3e9cce65599" is_pre_election: true
I20260809 00:50:54.140625 27166 raft_consensus.cc:2454] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6b713b5f1b4dd79a86138ee38b4151 in term 0.
I20260809 00:50:54.140877 26984 raft_consensus.cc:2454] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b6b713b5f1b4dd79a86138ee38b4151 in term 0.
I20260809 00:50:54.141289 26706 leader_election.cc:302] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6b713b5f1b4dd79a86138ee38b4151, b4e1500856be460cb0e7670f3cb41b21; no voters:
I20260809 00:50:54.141739 27264 raft_consensus.cc:2781] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:50:54.141872 27264 raft_consensus.cc:482] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:50:54.141980 27264 raft_consensus.cc:3037] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:54.144217 27264 raft_consensus.cc:504] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.144855 27264 leader_election.cc:288] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [CANDIDATE]: Term 1 election: Requested vote from peers 8653fdd7892b498db126f3e9cce65599 (127.28.92.130:39917), b4e1500856be460cb0e7670f3cb41b21 (127.28.92.131:34951)
I20260809 00:50:54.145259 26984 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf8fcb85104471849575c4a00a3ced" candidate_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8653fdd7892b498db126f3e9cce65599"
I20260809 00:50:54.145324 27166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdbf8fcb85104471849575c4a00a3ced" candidate_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4e1500856be460cb0e7670f3cb41b21"
I20260809 00:50:54.145437 26984 raft_consensus.cc:3037] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:54.145515 27166 raft_consensus.cc:3037] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:54.147650 26984 raft_consensus.cc:2454] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6b713b5f1b4dd79a86138ee38b4151 in term 1.
I20260809 00:50:54.147689 27166 raft_consensus.cc:2454] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b6b713b5f1b4dd79a86138ee38b4151 in term 1.
I20260809 00:50:54.148038 26703 leader_election.cc:302] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b6b713b5f1b4dd79a86138ee38b4151, 8653fdd7892b498db126f3e9cce65599; no voters:
I20260809 00:50:54.148312 27264 raft_consensus.cc:2781] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:54.148777 27264 raft_consensus.cc:686] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 1 LEADER]: Becoming Leader. State: Replica: 6b6b713b5f1b4dd79a86138ee38b4151, State: Running, Role: LEADER
I20260809 00:50:54.149292 27264 consensus_queue.cc:237] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } }
I20260809 00:50:54.153924 26597 catalog_manager.cc:5495] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b6b713b5f1b4dd79a86138ee38b4151 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b6b713b5f1b4dd79a86138ee38b4151" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 45843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 } health_report { overall_health: UNKNOWN } } }
I20260809 00:50:54.185935 27252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.180701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59056 (local address 127.28.92.129:45843)
0809 00:50:54.180900 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.180905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.180924 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:50:54.181101 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.181105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.181207 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.181329 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:54.181642 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.182468 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.183906 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.184360 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.184450 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.184893 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:54.185380 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:50:54.185508 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.185584 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.185622 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:50:54.196872 27166 raft_consensus.cc:1261] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 1 FOLLOWER]: Refusing update from remote peer 6b6b713b5f1b4dd79a86138ee38b4151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:54.196882 26984 raft_consensus.cc:1261] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 1 FOLLOWER]: Refusing update from remote peer 6b6b713b5f1b4dd79a86138ee38b4151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:54.197852 27269 consensus_queue.cc:1035] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8653fdd7892b498db126f3e9cce65599" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 39917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:54.198225 27264 consensus_queue.cc:1035] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4e1500856be460cb0e7670f3cb41b21" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 34951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:54.208966 27274 mvcc.cc:205] Tried to move back new op lower bound from 7316425335578746880 to 7316425335400034304. Current Snapshot: MvccSnapshot[applied={T|T < 7316425335578746880}]
I20260809 00:50:54.225085 26596 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:54.225471 26596 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54410:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:54.229790 26596 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 229ae79ddc3a4b19bf9534f428ecbc4c: Sending DeleteTablet for 3 replicas of tablet bdbf8fcb85104471849575c4a00a3ced
I20260809 00:50:54.231472 27138 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbf8fcb85104471849575c4a00a3ced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:54 UTC) from {username='slave'} at 127.0.0.1:59856
I20260809 00:50:54.231467 26957 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbf8fcb85104471849575c4a00a3ced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:54 UTC) from {username='slave'} at 127.0.0.1:55438
I20260809 00:50:54.232306 26762 tablet_service.cc:1514] Processing DeleteTablet for tablet bdbf8fcb85104471849575c4a00a3ced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:54 UTC) from {username='slave'} at 127.0.0.1:59048
I20260809 00:50:54.233222 27289 tablet_replica.cc:330] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: stopping tablet replica
I20260809 00:50:54.233464 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 26682
I20260809 00:50:54.233723 27289 raft_consensus.cc:2229] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:50:54.235103 27289 raft_consensus.cc:2258] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:54.237366 27289 ts_tablet_manager.cc:1905] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:54.247202 27289 ts_tablet_manager.cc:1918] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:54.247423 27289 log.cc:1196] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/bdbf8fcb85104471849575c4a00a3ced
I20260809 00:50:54.247982 27289 ts_tablet_manager.cc:1939] T bdbf8fcb85104471849575c4a00a3ced P 6b6b713b5f1b4dd79a86138ee38b4151: Deleting consensus metadata
I20260809 00:50:54.249938 26576 catalog_manager.cc:4841] TS 6b6b713b5f1b4dd79a86138ee38b4151 (127.28.92.129:45843): tablet bdbf8fcb85104471849575c4a00a3ced (table test-table [id=63f1a33dcfa04795a7f7b959641a4856]) successfully deleted
I20260809 00:50:54.251855 27288 tablet_replica.cc:330] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: stopping tablet replica
I20260809 00:50:54.252385 27288 raft_consensus.cc:2229] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:54.252971 27288 raft_consensus.cc:2258] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:54.253942 27287 tablet_replica.cc:330] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: stopping tablet replica
I20260809 00:50:54.255102 27252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.235798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59068 (local address 127.28.92.129:45843)
0809 00:50:54.235991 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.236002 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.242122 (+ 6120us) server_negotiation.cc:407] Connection header received
0809 00:50:54.242392 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.242401 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.242564 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.242701 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:54.243194 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.244402 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.246286 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.246887 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.246982 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.248486 (+ 1504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:54.248498 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:54.248516 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:54.249309 (+ 793us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:54.249372 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:54.249396 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:54.249478 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.253829 (+ 4351us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.253973 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 00:50:54.255815 27288 ts_tablet_manager.cc:1905] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:54.255774 27287 raft_consensus.cc:2229] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:54.256493 27287 raft_consensus.cc:2258] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:54.256596 26852 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:54.258819 27287 ts_tablet_manager.cc:1905] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:54.263379 27288 ts_tablet_manager.cc:1918] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:54.263569 27288 log.cc:1196] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/bdbf8fcb85104471849575c4a00a3ced
I20260809 00:50:54.264097 27288 ts_tablet_manager.cc:1939] T bdbf8fcb85104471849575c4a00a3ced P 8653fdd7892b498db126f3e9cce65599: Deleting consensus metadata
I20260809 00:50:54.265980 27287 ts_tablet_manager.cc:1918] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:54.266075 26576 catalog_manager.cc:4841] TS 8653fdd7892b498db126f3e9cce65599 (127.28.92.130:39917): tablet bdbf8fcb85104471849575c4a00a3ced (table test-table [id=63f1a33dcfa04795a7f7b959641a4856]) successfully deleted
I20260809 00:50:54.266155 27287 log.cc:1196] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/bdbf8fcb85104471849575c4a00a3ced
I20260809 00:50:54.266569 27287 ts_tablet_manager.cc:1939] T bdbf8fcb85104471849575c4a00a3ced P b4e1500856be460cb0e7670f3cb41b21: Deleting consensus metadata
I20260809 00:50:54.267999 26580 catalog_manager.cc:4841] TS b4e1500856be460cb0e7670f3cb41b21 (127.28.92.131:34951): tablet bdbf8fcb85104471849575c4a00a3ced (table test-table [id=63f1a33dcfa04795a7f7b959641a4856]) successfully deleted
I20260809 00:50:54.351404 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 26682
I20260809 00:50:54.375777 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 26864
I20260809 00:50:54.382019 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.376589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.28.92.130:39917)
0809 00:50:54.376777 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.376782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.376801 (+ 19us) server_negotiation.cc:407] Connection header received
0809 00:50:54.376858 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.376862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.376939 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.377039 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:54.377358 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.378150 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.379357 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.379735 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.379821 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.380726 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:54.380734 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:54.380748 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:54.381314 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:54.381361 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:54.381381 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:54.381467 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.381545 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.381629 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:50:54.382714 27034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:54.469745 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 26864
I20260809 00:50:54.493336 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 27045
I20260809 00:50:54.500195 27250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:54.494125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59868 (local address 127.28.92.131:34951)
0809 00:50:54.494310 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:54.494315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:54.494383 (+ 68us) server_negotiation.cc:407] Connection header received
0809 00:50:54.494571 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:54.494576 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:54.494666 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:54.494752 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:54.495146 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.495890 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.497174 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:54.497573 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:54.497960 (+ 387us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:54.498823 (+ 863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:54.498840 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:54.498856 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:54.499458 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:54.499507 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:54.499527 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:54.499628 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:54.499762 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 00:50:54.499883 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:50:54.500869 27219 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:54.588161 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 27045
I20260809 00:50:54.611411 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 26558
I20260809 00:50:54.612475 26641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:54.741811 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 26558
2026-08-09T00:50:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2756 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:50:54 dist-test-slave-t7g5 krb5kdc[27299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:50:54 dist-test-slave-t7g5 krb5kdc[27299](info): set up 2 sockets
Aug 09 00:50:54 dist-test-slave-t7g5 krb5kdc[27299](info): commencing operation
krb5kdc: starting...
W20260809 00:50:56.000171 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:50:56 dist-test-slave-t7g5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:50:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:50:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:50:56.304631 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43273
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:43273
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:56.647363 27315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:56.647661 27315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:56.647796 27315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:56.655090 27315 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:56.655205 27315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:56.655277 27315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:56.655360 27315 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:56.655418 27315 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:56.665647 27315 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:43273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:43273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:56.667073 27315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:56.668401 27315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:56.679991 27323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:56.679967 27326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:56.679942 27329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:56.680994 27315 server_base.cc:1034] running on GCE node
I20260809 00:50:56.681830 27315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:56.683207 27315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:56.684422 27315 hybrid_clock.cc:648] HybridClock initialized: now 1786236656684360 us; error 43 us; skew 500 ppm
I20260809 00:50:56.684789 27315 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:56 dist-test-slave-t7g5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236656, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:56.691077 27315 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:50:56.692559 27315 webserver.cc:460] Webserver started at http://127.28.92.190:39721/ using document root <none> and password file <none>
I20260809 00:50:56.693230 27315 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:56.693336 27315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:56.693598 27315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:56.696648 27315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "27a18183ee754b8d8cdc9b0c71babdb2"
format_stamp: "Formatted at 2026-08-09 00:50:56 on dist-test-slave-t7g5"
server_key: "d983ad581199985e8dce1f6814cc68ce"
server_key_iv: "1dc70dd018263429f18e0da7e5d34dfe"
server_key_version: "encryptionkey@0"
I20260809 00:50:56.697362 27315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "27a18183ee754b8d8cdc9b0c71babdb2"
format_stamp: "Formatted at 2026-08-09 00:50:56 on dist-test-slave-t7g5"
server_key: "d983ad581199985e8dce1f6814cc68ce"
server_key_iv: "1dc70dd018263429f18e0da7e5d34dfe"
server_key_version: "encryptionkey@0"
I20260809 00:50:56.702490 27315 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:50:56.705858 27338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:56.707131 27315 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:50:56.707283 27315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "27a18183ee754b8d8cdc9b0c71babdb2"
format_stamp: "Formatted at 2026-08-09 00:50:56 on dist-test-slave-t7g5"
server_key: "d983ad581199985e8dce1f6814cc68ce"
server_key_iv: "1dc70dd018263429f18e0da7e5d34dfe"
server_key_version: "encryptionkey@0"
I20260809 00:50:56.707458 27315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:56.745328 27315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:56.749311 27315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:56.749564 27315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:56.767877 27315 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:43273
I20260809 00:50:56.767881 27408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:43273 every 8 connection(s)
I20260809 00:50:56.769294 27315 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:56.773152 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:56.773975 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 27315
I20260809 00:50:56.774132 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:50:56.774557 29042 external_mini_cluster.cc:1428] Setting key f3a987723bb3b274a7e435423ee642e4
I20260809 00:50:56.787508 27410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2: Bootstrap starting.
Aug 09 00:50:56 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:56.790709 27410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:56.792121 27410 log.cc:824] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:56.795734 27410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2: No bootstrap required, opened a new log
I20260809 00:50:56.799268 27415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:56.776364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43090 (local address 127.28.92.190:43273)
0809 00:50:56.777241 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:56.777255 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:56.777307 (+ 52us) server_negotiation.cc:407] Connection header received
0809 00:50:56.779725 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:56.779757 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:56.780253 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:56.780714 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:56.782127 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:56.784119 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:56.785457 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:56.786510 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:56.786690 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:56.790772 (+ 4082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:56.790785 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:56.790805 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:56.790854 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:56.794610 (+ 3756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:56.795359 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:56.795367 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:56.795375 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:56.795612 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:56.796006 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:56.796012 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:56.796015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:56.796734 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:56.797035 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:56.797393 (+ 358us) server_negotiation.cc:299] Negotiation successful
0809 00:50:56.797885 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":350,"threads_started":1}
I20260809 00:50:56.804960 27410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43273 } }
I20260809 00:50:56.805306 27410 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:56.805382 27410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27a18183ee754b8d8cdc9b0c71babdb2, State: Initialized, Role: FOLLOWER
I20260809 00:50:56.805946 27410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43273 } }
I20260809 00:50:56.806183 27410 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:56.806284 27410 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:56.806408 27410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:56.808799 27410 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43273 } }
I20260809 00:50:56.809243 27410 leader_election.cc:302] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27a18183ee754b8d8cdc9b0c71babdb2; no voters:
I20260809 00:50:56.809810 27410 leader_election.cc:288] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:50:56.809916 27418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:56.810568 27418 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [term 1 LEADER]: Becoming Leader. State: Replica: 27a18183ee754b8d8cdc9b0c71babdb2, State: Running, Role: LEADER
I20260809 00:50:56.811085 27418 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43273 } }
I20260809 00:50:56.812036 27410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:56.813951 27421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27a18183ee754b8d8cdc9b0c71babdb2. Latest consensus state: current_term: 1 leader_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43273 } } }
I20260809 00:50:56.813934 27419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27a18183ee754b8d8cdc9b0c71babdb2" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 43273 } } }
I20260809 00:50:56.814363 27419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:56.814363 27421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:56.816090 27425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:56.822273 27425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:56.832175 27425 catalog_manager.cc:1347] Generated new cluster ID: add92b2c6c884c57891aed3b1d49bee8
I20260809 00:50:56.832289 27425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:56.864663 27425 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:50:56.866101 27425 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:56.875499 27425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2: Generated new TSK 0
I20260809 00:50:56.876502 27425 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.28.92.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
Entry for principal kudu/127.28.92.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab.
I20260809 00:50:56.955212 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43273
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:57.291966 27448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:57.292271 27448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:57.292418 27448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:57.299840 27448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:57.299975 27448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:57.300127 27448 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:50:57.309933 27448 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.129.keytab
--principal=kudu/127.28.92.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43273
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:57.311275 27448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:57.312672 27448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:57.325605 27454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:57.325645 27459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:57.325699 27457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:57.326558 27448 server_base.cc:1034] running on GCE node
I20260809 00:50:57.327159 27448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:57.328066 27448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:57.329258 27448 hybrid_clock.cc:648] HybridClock initialized: now 1786236657329207 us; error 48 us; skew 500 ppm
I20260809 00:50:57.329540 27448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:57 dist-test-slave-t7g5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236657, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:57.332636 27448 init.cc:377] Logged in from keytab as kudu/127.28.92.129@KRBTEST.COM (short username kudu)
I20260809 00:50:57.334117 27448 webserver.cc:460] Webserver started at http://127.28.92.129:33225/ using document root <none> and password file <none>
I20260809 00:50:57.334848 27448 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:57.334970 27448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:57.335270 27448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:57.338171 27448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "1f3eba9553ee4fc5829742ccdbf054ee"
format_stamp: "Formatted at 2026-08-09 00:50:57 on dist-test-slave-t7g5"
server_key: "2e93571f841fbf296219bc0f4ccc69ab"
server_key_iv: "9a6d289f2831da8a1f26ce325b758bf1"
server_key_version: "encryptionkey@0"
I20260809 00:50:57.338917 27448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "1f3eba9553ee4fc5829742ccdbf054ee"
format_stamp: "Formatted at 2026-08-09 00:50:57 on dist-test-slave-t7g5"
server_key: "2e93571f841fbf296219bc0f4ccc69ab"
server_key_iv: "9a6d289f2831da8a1f26ce325b758bf1"
server_key_version: "encryptionkey@0"
I20260809 00:50:57.343881 27448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 00:50:57.347252 27468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:57.348551 27448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 00:50:57.348704 27448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "1f3eba9553ee4fc5829742ccdbf054ee"
format_stamp: "Formatted at 2026-08-09 00:50:57 on dist-test-slave-t7g5"
server_key: "2e93571f841fbf296219bc0f4ccc69ab"
server_key_iv: "9a6d289f2831da8a1f26ce325b758bf1"
server_key_version: "encryptionkey@0"
I20260809 00:50:57.348879 27448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:57.371618 27448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:57.375779 27448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:57.376060 27448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:57.376983 27448 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:57.378381 27448 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:57.378463 27448 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:57.378583 27448 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:57.378638 27448 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:57.407287 27448 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:38845
I20260809 00:50:57.407343 27622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:38845 every 8 connection(s)
I20260809 00:50:57.408572 27448 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:50:57.416152 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 27448
I20260809 00:50:57.416329 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:50:57.416780 29042 external_mini_cluster.cc:1428] Setting key 04b97d35ae3595034833962566e64381
Aug 09 00:50:57 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236657, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.129@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:57.428865 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:57.411193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:46511 (local address 127.28.92.190:43273)
0809 00:50:57.411643 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:57.411647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:57.412624 (+ 977us) server_negotiation.cc:407] Connection header received
0809 00:50:57.414511 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:57.414517 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:57.414602 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:57.414699 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:57.416222 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.417168 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.419007 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.419427 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.419543 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:57.423259 (+ 3716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:57.423265 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:57.423268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:57.423301 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:57.425851 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:57.426681 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:57.426685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:57.426687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:57.426801 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:57.427229 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:57.427232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:57.427234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:57.427503 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:57.427608 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:57.428430 (+ 822us) server_negotiation.cc:299] Negotiation successful
0809 00:50:57.428604 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":226,"threads_started":1}
I20260809 00:50:57.430212 27631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:57.411714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43273 (local address 127.28.92.129:46511)
0809 00:50:57.412475 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:57.412518 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:57.414252 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:57.414946 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:57.414954 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:57.415471 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:57.416050 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:57.416069 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.417313 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.417317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:57.418869 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:57.418883 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.419658 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.419665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:57.419898 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:57.420545 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:57.420567 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:57.423041 (+ 2474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:57.425990 (+ 2949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:57.425999 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:57.426015 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:57.426579 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:57.426893 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:57.426897 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:57.426900 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:57.427140 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:57.427624 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:57.427632 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:57.428049 (+ 417us) client_negotiation.cc:769] Sending connection context
0809 00:50:57.428343 (+ 294us) client_negotiation.cc:240] Negotiation successful
0809 00:50:57.428855 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":295,"threads_started":1}
I20260809 00:50:57.431823 27626 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43273
I20260809 00:50:57.432127 27626 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:57.432832 27626 heartbeater.cc:511] Master 127.28.92.190:43273 requested a full tablet report, sending...
I20260809 00:50:57.434872 27360 ts_manager.cc:194] Registered new tserver with Master: 1f3eba9553ee4fc5829742ccdbf054ee (127.28.92.129:38845)
I20260809 00:50:57.436327 27360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.129@KRBTEST.COM'} at 127.28.92.129:46511
WARNING: no policy specified for kudu/127.28.92.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
Entry for principal kudu/127.28.92.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab.
I20260809 00:50:57.480957 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43273
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:57.813982 27636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:57.814265 27636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:57.814407 27636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:57.821599 27636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:57.821738 27636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:57.821894 27636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:50:57.831620 27636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.130.keytab
--principal=kudu/127.28.92.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43273
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:57.832845 27636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:57.834190 27636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:57.846524 27645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:57.846577 27642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:57.846798 27643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:57.847661 27636 server_base.cc:1034] running on GCE node
I20260809 00:50:57.848233 27636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:57.849128 27636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:57.850322 27636 hybrid_clock.cc:648] HybridClock initialized: now 1786236657850272 us; error 44 us; skew 500 ppm
I20260809 00:50:57.850623 27636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:57 dist-test-slave-t7g5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236657, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:57.853593 27636 init.cc:377] Logged in from keytab as kudu/127.28.92.130@KRBTEST.COM (short username kudu)
I20260809 00:50:57.855008 27636 webserver.cc:460] Webserver started at http://127.28.92.130:33279/ using document root <none> and password file <none>
I20260809 00:50:57.855661 27636 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:57.855772 27636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:57.856069 27636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:57.858897 27636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "1ec46b94c4a242ce896397eb37dce789"
format_stamp: "Formatted at 2026-08-09 00:50:57 on dist-test-slave-t7g5"
server_key: "560ae4b95d84e145e5bb8315db081471"
server_key_iv: "338be7f9349c4d40c4b12b5ff56e25ab"
server_key_version: "encryptionkey@0"
I20260809 00:50:57.859650 27636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "1ec46b94c4a242ce896397eb37dce789"
format_stamp: "Formatted at 2026-08-09 00:50:57 on dist-test-slave-t7g5"
server_key: "560ae4b95d84e145e5bb8315db081471"
server_key_iv: "338be7f9349c4d40c4b12b5ff56e25ab"
server_key_version: "encryptionkey@0"
I20260809 00:50:57.864579 27636 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 00:50:57.867838 27654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:57.869035 27636 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 00:50:57.869176 27636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "1ec46b94c4a242ce896397eb37dce789"
format_stamp: "Formatted at 2026-08-09 00:50:57 on dist-test-slave-t7g5"
server_key: "560ae4b95d84e145e5bb8315db081471"
server_key_iv: "338be7f9349c4d40c4b12b5ff56e25ab"
server_key_version: "encryptionkey@0"
I20260809 00:50:57.869340 27636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:57.883975 27636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:57.887786 27636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:57.888054 27636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:57.888957 27636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:57.890249 27636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:57.890333 27636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:57.890453 27636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:57.890509 27636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:57.920462 27636 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:34599
I20260809 00:50:57.920588 27828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:34599 every 8 connection(s)
I20260809 00:50:57.921765 27636 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:50:57.928653 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 27636
I20260809 00:50:57.928814 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:50:57.929250 29042 external_mini_cluster.cc:1428] Setting key 7c20ce9377aecb6fcf91a93ff1223e5b
Aug 09 00:50:57 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236657, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.130@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:57.940846 27630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:57.924186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:36889 (local address 127.28.92.190:43273)
0809 00:50:57.924368 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:57.924373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:57.925522 (+ 1149us) server_negotiation.cc:407] Connection header received
0809 00:50:57.927292 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:57.927297 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:57.927390 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:57.927476 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:57.928972 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.929814 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.931596 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.932003 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.932113 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:57.935407 (+ 3294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:57.935411 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:57.935414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:57.935447 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:57.937910 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:57.938583 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:57.938587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:57.938590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:57.938719 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:57.939141 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:57.939144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:57.939146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:57.939422 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:57.939556 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:57.940243 (+ 687us) server_negotiation.cc:299] Negotiation successful
0809 00:50:57.940490 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:50:57.941800 27835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:57.924673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43273 (local address 127.28.92.130:36889)
0809 00:50:57.925369 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:57.925411 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:57.927033 (+ 1622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:57.927710 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:57.927718 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:57.928221 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:57.928801 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:57.928831 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.929972 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.929976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:57.931454 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:57.931468 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:57.932215 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:57.932223 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:57.932441 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:57.933039 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:57.933061 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:57.935191 (+ 2130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:57.938043 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:57.938052 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:57.938068 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:57.938472 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:57.938830 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:57.938835 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:57.938839 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:57.939035 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:57.939546 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:57.939553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:57.939886 (+ 333us) client_negotiation.cc:769] Sending connection context
0809 00:50:57.940122 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 00:50:57.940631 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":260,"threads_started":1}
I20260809 00:50:57.943189 27832 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43273
I20260809 00:50:57.943473 27832 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:57.944180 27832 heartbeater.cc:511] Master 127.28.92.190:43273 requested a full tablet report, sending...
I20260809 00:50:57.945597 27360 ts_manager.cc:194] Registered new tserver with Master: 1ec46b94c4a242ce896397eb37dce789 (127.28.92.130:34599)
I20260809 00:50:57.946405 27360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.130@KRBTEST.COM'} at 127.28.92.130:36889
WARNING: no policy specified for kudu/127.28.92.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
Entry for principal kudu/127.28.92.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab.
I20260809 00:50:57.990770 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43273
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:50:58.329192 27839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:58.329463 27839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:58.329599 27839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:58.336558 27839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:58.336668 27839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:58.336820 27839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:50:58.345986 27839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.131.keytab
--principal=kudu/127.28.92.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:43273
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:58.347129 27839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:58.348342 27839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:58.360668 27847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:58.360735 27849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:58.360707 27846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:58.361670 27839 server_base.cc:1034] running on GCE node
I20260809 00:50:58.362241 27839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:58.363095 27839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:58.364290 27839 hybrid_clock.cc:648] HybridClock initialized: now 1786236658364244 us; error 37 us; skew 500 ppm
I20260809 00:50:58.364573 27839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:50:58 dist-test-slave-t7g5 krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236658, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:50:58.367581 27839 init.cc:377] Logged in from keytab as kudu/127.28.92.131@KRBTEST.COM (short username kudu)
I20260809 00:50:58.368898 27839 webserver.cc:460] Webserver started at http://127.28.92.131:40173/ using document root <none> and password file <none>
I20260809 00:50:58.369529 27839 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:58.369642 27839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:58.369958 27839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:58.372761 27839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "a48e4642cb1e4a149acf9e7373b60e09"
format_stamp: "Formatted at 2026-08-09 00:50:58 on dist-test-slave-t7g5"
server_key: "2bcfbabeaab9165663d638954b93970f"
server_key_iv: "bcc019eccd2923d1330584bb7050e00f"
server_key_version: "encryptionkey@0"
I20260809 00:50:58.373507 27839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "a48e4642cb1e4a149acf9e7373b60e09"
format_stamp: "Formatted at 2026-08-09 00:50:58 on dist-test-slave-t7g5"
server_key: "2bcfbabeaab9165663d638954b93970f"
server_key_iv: "bcc019eccd2923d1330584bb7050e00f"
server_key_version: "encryptionkey@0"
I20260809 00:50:58.378520 27839 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 00:50:58.381913 27861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:58.383212 27839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:50:58.383358 27839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "a48e4642cb1e4a149acf9e7373b60e09"
format_stamp: "Formatted at 2026-08-09 00:50:58 on dist-test-slave-t7g5"
server_key: "2bcfbabeaab9165663d638954b93970f"
server_key_iv: "bcc019eccd2923d1330584bb7050e00f"
server_key_version: "encryptionkey@0"
I20260809 00:50:58.383538 27839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:58.409116 27839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:58.413944 27839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:58.414187 27839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:58.415081 27839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:50:58.416352 27839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:50:58.416427 27839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:58.416549 27839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:50:58.416600 27839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:58.439242 27626 heartbeater.cc:503] Master 127.28.92.190:43273 was elected leader, sending a full tablet report...
I20260809 00:50:58.446768 27839 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:46035
I20260809 00:50:58.446816 28023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:46035 every 8 connection(s)
I20260809 00:50:58.448004 27839 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:50:58.450139 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 27839
I20260809 00:50:58.450349 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:50:58.450847 29042 external_mini_cluster.cc:1428] Setting key 01e5909480933c7c49fc12bf61b9bd25
Aug 09 00:50:58 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236658, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.131@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:50:58.467751 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.450468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:34243 (local address 127.28.92.190:43273)
0809 00:50:58.450999 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.451006 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.452263 (+ 1257us) server_negotiation.cc:407] Connection header received
0809 00:50:58.454236 (+ 1973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.454249 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.454336 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.454447 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:58.455960 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.456746 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.458275 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.458680 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.458771 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.462122 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:58.462127 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:58.462130 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:58.462162 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:58.464796 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.465611 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.465616 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.465618 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.465802 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.466290 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.466294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.466296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.466578 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:58.466695 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.467309 (+ 614us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.467476 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":237,"threads_started":1}
I20260809 00:50:58.468680 28034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.450999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:43273 (local address 127.28.92.131:34243)
0809 00:50:58.452097 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:58.452144 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:58.453983 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:58.454632 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:58.454641 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:58.455216 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:50:58.455811 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.455832 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.456864 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.456868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.458131 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.458150 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.458878 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.458887 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.459086 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.459711 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:50:58.459733 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:50:58.461926 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:50:58.464939 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:58.464947 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:58.464963 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:58.465474 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:58.465940 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:50:58.465944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:50:58.465948 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:50:58.466173 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:50:58.466672 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:50:58.466678 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:50:58.466993 (+ 315us) client_negotiation.cc:769] Sending connection context
0809 00:50:58.467208 (+ 215us) client_negotiation.cc:240] Negotiation successful
0809 00:50:58.467570 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":623,"threads_started":1}
I20260809 00:50:58.469996 28025 heartbeater.cc:347] Connected to a master server at 127.28.92.190:43273
I20260809 00:50:58.470278 28025 heartbeater.cc:464] Registering TS with master...
I20260809 00:50:58.470952 28025 heartbeater.cc:511] Master 127.28.92.190:43273 requested a full tablet report, sending...
I20260809 00:50:58.472323 27360 ts_manager.cc:194] Registered new tserver with Master: a48e4642cb1e4a149acf9e7373b60e09 (127.28.92.131:46035)
I20260809 00:50:58.473152 27360 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.28.92.131@KRBTEST.COM'} at 127.28.92.131:34243
I20260809 00:50:58.478168 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:50:58.494499 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.482226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43102 (local address 127.28.92.190:43273)
0809 00:50:58.482397 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.482403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.482807 (+ 404us) server_negotiation.cc:407] Connection header received
0809 00:50:58.482965 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.482971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.483065 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.483149 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:58.484534 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.485226 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.486569 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.486988 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.487102 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.489361 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:58.489366 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:58.489369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:58.489398 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:58.491783 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.492429 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.492434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.492438 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.492557 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.493012 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.493018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.493022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.493352 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:58.493586 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.493983 (+ 397us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.494202 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:50:58.498312 27360 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:50:58.505120 27360 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:50:58.526894 28055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.516836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:46035 (local address 127.0.0.1:58384)
0809 00:50:58.517949 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:58.517995 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:58.518181 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:58.518738 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:58.518745 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:58.518786 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:58.519154 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.519167 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.521004 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.521009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.524042 (+ 3033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.524062 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.525861 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.525869 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.526088 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.526151 (+ 63us) client_negotiation.cc:769] Sending connection context
0809 00:50:58.526290 (+ 139us) client_negotiation.cc:240] Negotiation successful
0809 00:50:58.526478 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"thread_start_us":2589,"threads_started":1}
I20260809 00:50:58.526906 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.517176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.28.92.131:46035)
0809 00:50:58.518216 (+ 1040us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.518224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.518257 (+ 33us) server_negotiation.cc:407] Connection header received
0809 00:50:58.518365 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.518373 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.518554 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.518711 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:58.519386 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.520837 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.524244 (+ 3407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.525630 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.525799 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.526037 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.526365 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.526541 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":875,"thread_start_us":797,"threads_started":1}
I20260809 00:50:58.528697 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.517808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38128 (local address 127.28.92.129:38845)
0809 00:50:58.519440 (+ 1632us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.519448 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.519950 (+ 502us) server_negotiation.cc:407] Connection header received
0809 00:50:58.520067 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.520075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.520292 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.520496 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:58.522524 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.523852 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.525802 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.527176 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.527271 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.527454 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.528248 (+ 794us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.528420 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1472,"thread_start_us":1290,"threads_started":1}
I20260809 00:50:58.530107 28060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.519816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:34599 (local address 127.0.0.1:38218)
0809 00:50:58.522482 (+ 2666us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:58.522504 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:58.522627 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:58.523195 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:58.523200 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:58.523225 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:58.523621 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.523633 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.525886 (+ 2253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.525891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.527723 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.527736 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.529350 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.529357 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.529516 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.529539 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 00:50:58.529617 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 00:50:58.529764 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2545,"thread_start_us":2361,"threads_started":1}
I20260809 00:50:58.530133 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.520220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38218 (local address 127.28.92.130:34599)
0809 00:50:58.521555 (+ 1335us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.521560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.522589 (+ 1029us) server_negotiation.cc:407] Connection header received
0809 00:50:58.522785 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.522793 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.523001 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.523182 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:58.523844 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.525722 (+ 1878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.527868 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.529152 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.529281 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.529457 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.529693 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.529866 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1208,"thread_start_us":1131,"threads_started":1}
I20260809 00:50:58.530318 28054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.517229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:38845 (local address 127.0.0.1:38128)
0809 00:50:58.519685 (+ 2456us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:58.519702 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:58.519826 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:58.520734 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:58.520740 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:58.520782 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:58.522369 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.522381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.524014 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.524018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.525609 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.525622 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.527882 (+ 2260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.527888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.528045 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.528075 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 00:50:58.529816 (+ 1741us) client_negotiation.cc:240] Negotiation successful
0809 00:50:58.529951 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2343,"thread_start_us":294,"threads_started":1}
I20260809 00:50:58.531731 27934 tablet_service.cc:1467] Processing CreateTablet for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 (DEFAULT_TABLE table=test-table [id=ffce39919ea749a6aecad573b2a6273d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:58.532986 27934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:58.533733 27526 tablet_service.cc:1467] Processing CreateTablet for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 (DEFAULT_TABLE table=test-table [id=ffce39919ea749a6aecad573b2a6273d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:58.533733 27725 tablet_service.cc:1467] Processing CreateTablet for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 (DEFAULT_TABLE table=test-table [id=ffce39919ea749a6aecad573b2a6273d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:50:58.535117 27725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:58.535120 27526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:58.544078 28062 tablet_bootstrap.cc:492] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Bootstrap starting.
I20260809 00:50:58.547528 28062 tablet_bootstrap.cc:654] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:58.548514 28062 log.cc:824] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:58.549400 28066 tablet_bootstrap.cc:492] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Bootstrap starting.
I20260809 00:50:58.550232 28065 tablet_bootstrap.cc:492] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Bootstrap starting.
I20260809 00:50:58.552501 28062 tablet_bootstrap.cc:492] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: No bootstrap required, opened a new log
I20260809 00:50:58.552795 28062 ts_tablet_manager.cc:1397] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260809 00:50:58.553884 28065 tablet_bootstrap.cc:654] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:58.553879 28066 tablet_bootstrap.cc:654] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:58.555119 28066 log.cc:824] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:58.556102 28065 log.cc:824] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:58.559266 28065 tablet_bootstrap.cc:492] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: No bootstrap required, opened a new log
I20260809 00:50:58.559561 28065 ts_tablet_manager.cc:1397] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.006s
I20260809 00:50:58.560828 28062 raft_consensus.cc:348] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.561164 28062 raft_consensus.cc:374] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:58.561252 28062 raft_consensus.cc:729] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48e4642cb1e4a149acf9e7373b60e09, State: Initialized, Role: FOLLOWER
I20260809 00:50:58.561805 28062 consensus_queue.cc:260] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.561985 28066 tablet_bootstrap.cc:492] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: No bootstrap required, opened a new log
I20260809 00:50:58.562237 28066 ts_tablet_manager.cc:1397] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.009s
I20260809 00:50:58.562855 28025 heartbeater.cc:503] Master 127.28.92.190:43273 was elected leader, sending a full tablet report...
I20260809 00:50:58.563534 28062 ts_tablet_manager.cc:1428] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260809 00:50:58.569619 28065 raft_consensus.cc:348] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.570067 28065 raft_consensus.cc:374] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:58.570166 28065 raft_consensus.cc:729] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f3eba9553ee4fc5829742ccdbf054ee, State: Initialized, Role: FOLLOWER
I20260809 00:50:58.570768 28065 consensus_queue.cc:260] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.572469 28065 ts_tablet_manager.cc:1428] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260809 00:50:58.572652 28066 raft_consensus.cc:348] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.573026 28066 raft_consensus.cc:374] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:58.573127 28066 raft_consensus.cc:729] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec46b94c4a242ce896397eb37dce789, State: Initialized, Role: FOLLOWER
I20260809 00:50:58.573684 28066 consensus_queue.cc:260] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.574740 27832 heartbeater.cc:503] Master 127.28.92.190:43273 was elected leader, sending a full tablet report...
I20260809 00:50:58.575322 28066 ts_tablet_manager.cc:1428] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Time spent starting tablet: real 0.013s user 0.005s sys 0.007s
I20260809 00:50:58.579883 28077 raft_consensus.cc:482] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:50:58.580137 28077 raft_consensus.cc:504] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.581533 28077 leader_election.cc:288] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a48e4642cb1e4a149acf9e7373b60e09 (127.28.92.131:46035), 1f3eba9553ee4fc5829742ccdbf054ee (127.28.92.129:38845)
I20260809 00:50:58.587905 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.582300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:35447 (local address 127.28.92.131:46035)
0809 00:50:58.582482 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.582488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.582755 (+ 267us) server_negotiation.cc:407] Connection header received
0809 00:50:58.582933 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.582938 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.582998 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.583071 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:58.583601 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.584345 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.586062 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.586937 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.587079 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.587154 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.587498 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.587627 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 00:50:58.588100 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.581964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:46035 (local address 127.28.92.130:35447)
0809 00:50:58.582661 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:58.582677 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:58.582807 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:58.583097 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:58.583101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:58.583126 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:58.583474 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.583482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.584466 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.584472 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.585917 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.585930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.587158 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.587168 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.587339 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.587373 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 00:50:58.587469 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 00:50:58.587756 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":374,"threads_started":1}
I20260809 00:50:58.589061 27963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05a5ade427f4b7e81d1b7e8c1a92ec7" candidate_uuid: "1ec46b94c4a242ce896397eb37dce789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48e4642cb1e4a149acf9e7373b60e09" is_pre_election: true
I20260809 00:50:58.589571 27963 raft_consensus.cc:2454] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec46b94c4a242ce896397eb37dce789 in term 0.
I20260809 00:50:58.590229 27659 leader_election.cc:302] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec46b94c4a242ce896397eb37dce789, a48e4642cb1e4a149acf9e7373b60e09; no voters:
I20260809 00:50:58.590590 28077 raft_consensus.cc:2781] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:50:58.590718 28077 raft_consensus.cc:482] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:50:58.590842 28077 raft_consensus.cc:3037] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:58.592881 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.581972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:38845 (local address 127.28.92.130:49447)
0809 00:50:58.587176 (+ 5204us) negotiation.cc:107] Waiting for socket to connect
0809 00:50:58.587191 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:50:58.587303 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:50:58.587617 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:50:58.587622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:50:58.587647 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:50:58.588064 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.588078 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.589238 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.589241 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.590718 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:50:58.590731 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.592252 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.592258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:50:58.592398 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.592422 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 00:50:58.592498 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 00:50:58.592586 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5088,"mutex_wait_us":128,"thread_start_us":4761,"threads_started":1}
I20260809 00:50:58.592900 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.581937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:49447 (local address 127.28.92.129:38845)
0809 00:50:58.582103 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.582109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.587277 (+ 5168us) server_negotiation.cc:407] Connection header received
0809 00:50:58.587413 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.587418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.587495 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.587577 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:50:58.588237 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.589109 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.590873 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.592043 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.592200 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.592283 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.592548 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.592672 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 00:50:58.593745 27559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05a5ade427f4b7e81d1b7e8c1a92ec7" candidate_uuid: "1ec46b94c4a242ce896397eb37dce789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" is_pre_election: true
I20260809 00:50:58.593874 28077 raft_consensus.cc:504] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.594247 27559 raft_consensus.cc:2454] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ec46b94c4a242ce896397eb37dce789 in term 0.
I20260809 00:50:58.594571 28077 leader_election.cc:288] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [CANDIDATE]: Term 1 election: Requested vote from peers a48e4642cb1e4a149acf9e7373b60e09 (127.28.92.131:46035), 1f3eba9553ee4fc5829742ccdbf054ee (127.28.92.129:38845)
I20260809 00:50:58.594810 27963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05a5ade427f4b7e81d1b7e8c1a92ec7" candidate_uuid: "1ec46b94c4a242ce896397eb37dce789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a48e4642cb1e4a149acf9e7373b60e09"
I20260809 00:50:58.594874 27559 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c05a5ade427f4b7e81d1b7e8c1a92ec7" candidate_uuid: "1ec46b94c4a242ce896397eb37dce789" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f3eba9553ee4fc5829742ccdbf054ee"
I20260809 00:50:58.595012 27963 raft_consensus.cc:3037] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:58.595046 27559 raft_consensus.cc:3037] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:58.597316 27559 raft_consensus.cc:2454] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec46b94c4a242ce896397eb37dce789 in term 1.
I20260809 00:50:58.597332 27963 raft_consensus.cc:2454] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ec46b94c4a242ce896397eb37dce789 in term 1.
I20260809 00:50:58.597707 27655 leader_election.cc:302] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ec46b94c4a242ce896397eb37dce789, 1f3eba9553ee4fc5829742ccdbf054ee; no voters:
I20260809 00:50:58.597995 28077 raft_consensus.cc:2781] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:58.598395 28077 raft_consensus.cc:686] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 1 LEADER]: Becoming Leader. State: Replica: 1ec46b94c4a242ce896397eb37dce789, State: Running, Role: LEADER
I20260809 00:50:58.598891 28077 consensus_queue.cc:237] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } }
I20260809 00:50:58.603088 27359 catalog_manager.cc:5495] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ec46b94c4a242ce896397eb37dce789 (127.28.92.130). New cstate: current_term: 1 leader_uuid: "1ec46b94c4a242ce896397eb37dce789" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ec46b94c4a242ce896397eb37dce789" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 34599 } health_report { overall_health: HEALTHY } } }
I20260809 00:50:58.626526 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.621241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38222 (local address 127.28.92.130:34599)
0809 00:50:58.621409 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.621414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.621509 (+ 95us) server_negotiation.cc:407] Connection header received
0809 00:50:58.621729 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.621733 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.621827 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.621945 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:50:58.622247 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.622973 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.624400 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.624910 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.625013 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.625474 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:50:58.626031 (+ 557us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:50:58.626138 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.626241 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.626311 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 00:50:58.634621 27559 raft_consensus.cc:1261] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 1 FOLLOWER]: Refusing update from remote peer 1ec46b94c4a242ce896397eb37dce789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:58.634621 27963 raft_consensus.cc:1261] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 1 FOLLOWER]: Refusing update from remote peer 1ec46b94c4a242ce896397eb37dce789: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:50:58.635628 28080 consensus_queue.cc:1035] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a48e4642cb1e4a149acf9e7373b60e09" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 46035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:58.635993 28077 consensus_queue.cc:1035] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f3eba9553ee4fc5829742ccdbf054ee" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 38845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:50:58.648383 28087 mvcc.cc:205] Tried to move back new op lower bound from 7316425353757085696 to 7316425353624850432. Current Snapshot: MvccSnapshot[applied={T|T < 7316425353757085696}]
I20260809 00:50:58.649559 28083 mvcc.cc:205] Tried to move back new op lower bound from 7316425353757085696 to 7316425353624850432. Current Snapshot: MvccSnapshot[applied={T|T < 7316425353757085696 or (T in {7316425353757085696})}]
I20260809 00:50:58.661075 27359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:58.661327 27359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:50:58.664819 27359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 27a18183ee754b8d8cdc9b0c71babdb2: Sending DeleteTablet for 3 replicas of tablet c05a5ade427f4b7e81d1b7e8c1a92ec7
I20260809 00:50:58.665958 27526 tablet_service.cc:1514] Processing DeleteTablet for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:58 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38128
I20260809 00:50:58.665935 27934 tablet_service.cc:1514] Processing DeleteTablet for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:58 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:58384
I20260809 00:50:58.666488 27725 tablet_service.cc:1514] Processing DeleteTablet for tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:50:58 UTC) from {username='kudu', principal='kudu/127.28.92.190@KRBTEST.COM'} at 127.0.0.1:38218
I20260809 00:50:58.667385 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 27448
I20260809 00:50:58.679234 28097 tablet_replica.cc:330] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: stopping tablet replica
I20260809 00:50:58.679684 28097 raft_consensus.cc:2229] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 1 LEADER]: Raft consensus shutting down.
I20260809 00:50:58.680413 28097 raft_consensus.cc:2258] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:58.682540 28096 tablet_replica.cc:330] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: stopping tablet replica
I20260809 00:50:58.682950 28096 raft_consensus.cc:2229] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:58.683483 28096 raft_consensus.cc:2258] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:58.684320 28095 tablet_replica.cc:330] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: stopping tablet replica
I20260809 00:50:58.684729 28095 raft_consensus.cc:2229] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:50:58.685245 28095 raft_consensus.cc:2258] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:50:58.685829 28096 ts_tablet_manager.cc:1905] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:58.685971 28097 ts_tablet_manager.cc:1905] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:50:58.688632 28095 ts_tablet_manager.cc:1905] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 00:50:58 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.129@KRBTEST.COM
I20260809 00:50:58.692867 28096 ts_tablet_manager.cc:1918] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:58.693030 28096 log.cc:1196] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/c05a5ade427f4b7e81d1b7e8c1a92ec7
I20260809 00:50:58.693571 28096 ts_tablet_manager.cc:1939] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P a48e4642cb1e4a149acf9e7373b60e09: Deleting consensus metadata
I20260809 00:50:58.695623 27344 catalog_manager.cc:4841] TS a48e4642cb1e4a149acf9e7373b60e09 (127.28.92.131:46035): tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 (table test-table [id=ffce39919ea749a6aecad573b2a6273d]) successfully deleted
I20260809 00:50:58.696858 28095 ts_tablet_manager.cc:1918] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:58.697012 28095 log.cc:1196] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-0/wal/wals/c05a5ade427f4b7e81d1b7e8c1a92ec7
I20260809 00:50:58.697505 28095 ts_tablet_manager.cc:1939] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1f3eba9553ee4fc5829742ccdbf054ee: Deleting consensus metadata
I20260809 00:50:58.699327 27339 catalog_manager.cc:4841] TS 1f3eba9553ee4fc5829742ccdbf054ee (127.28.92.129:38845): tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 (table test-table [id=ffce39919ea749a6aecad573b2a6273d]) successfully deleted
I20260809 00:50:58.700196 28059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.668421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38142 (local address 127.28.92.129:38845)
0809 00:50:58.668611 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.668619 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.678123 (+ 9504us) server_negotiation.cc:407] Connection header received
0809 00:50:58.678777 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.678783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.678880 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.679002 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:58.681145 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.682507 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.684774 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.685490 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.685588 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.692072 (+ 6484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:58.692089 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:58.692107 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:58.692148 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:58.696373 (+ 4225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.697273 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.697297 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.697300 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.697467 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.698034 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.698039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.698043 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.698550 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:58.698856 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.699590 (+ 734us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.699828 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 00:50:58.700700 28097 ts_tablet_manager.cc:1918] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:50:58.700855 28097 log.cc:1196] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/c05a5ade427f4b7e81d1b7e8c1a92ec7
I20260809 00:50:58.701434 28097 ts_tablet_manager.cc:1939] T c05a5ade427f4b7e81d1b7e8c1a92ec7 P 1ec46b94c4a242ce896397eb37dce789: Deleting consensus metadata
I20260809 00:50:58.701690 27618 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:58.703289 27344 catalog_manager.cc:4841] TS 1ec46b94c4a242ce896397eb37dce789 (127.28.92.130:34599): tablet c05a5ade427f4b7e81d1b7e8c1a92ec7 (table test-table [id=ffce39919ea749a6aecad573b2a6273d]) successfully deleted
I20260809 00:50:58.790802 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 27448
I20260809 00:50:58.815618 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 27636
Aug 09 00:50:58 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.130@KRBTEST.COM
I20260809 00:50:58.831182 28061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.816366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38234 (local address 127.28.92.130:34599)
0809 00:50:58.816564 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.816570 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.816607 (+ 37us) server_negotiation.cc:407] Connection header received
0809 00:50:58.816811 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.816816 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.816897 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.816980 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:58.818355 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.819172 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.820400 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.820833 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.820943 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.825444 (+ 4501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:58.825459 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:58.825475 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:58.825513 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:58.828452 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.829081 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.829088 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.829090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.829247 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.829606 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.829610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.829612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.830008 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:58.830319 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.830593 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.830823 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 00:50:58.831869 27823 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:58.945775 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 27636
I20260809 00:50:58.970837 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 27839
Aug 09 00:50:58 dist-test-slave-t7g5 krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.131@KRBTEST.COM
I20260809 00:50:58.985852 28057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:58.971595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58394 (local address 127.28.92.131:46035)
0809 00:50:58.971778 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:58.971784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:58.971841 (+ 57us) server_negotiation.cc:407] Connection header received
0809 00:50:58.972037 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:58.972042 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:58.972108 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:58.972194 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:58.973522 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.974301 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.975593 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:58.976005 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:58.976113 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:58.980411 (+ 4298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:58.980432 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:58.980449 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:50:58.980487 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:58.983073 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.983714 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.983721 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.983724 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.983869 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:50:58.984227 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:50:58.984231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:50:58.984233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:50:58.984597 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:58.984875 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:58.985196 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 00:50:58.985438 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:50:58.986476 28017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:59.073599 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 27839
I20260809 00:50:59.094995 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 27315
I20260809 00:50:59.096079 27401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:50:59.207715 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 27315
2026-08-09T00:50:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4463 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T00:50:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:50:59Z Disabled control of system clock
I20260809 00:50:59.300135 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33325
--webserver_interface=127.28.92.190
--webserver_port=0
--builtin_ntp_servers=127.28.92.148:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:33325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 00:50:59.640018 28114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:50:59.640333 28114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:50:59.640470 28114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:50:59.647847 28114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:50:59.647971 28114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:50:59.648036 28114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:50:59.648108 28114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:50:59.648171 28114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:50:59.657678 28114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:33325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:50:59.658995 28114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:50:59.660789 28114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:50:59.672271 28123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:59.672353 28127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:50:59.672318 28125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:50:59.673260 28114 server_base.cc:1034] running on GCE node
I20260809 00:50:59.674115 28114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:50:59.675513 28114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:50:59.676738 28114 hybrid_clock.cc:648] HybridClock initialized: now 1786236659676682 us; error 32 us; skew 500 ppm
I20260809 00:50:59.677140 28114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:50:59.679436 28114 webserver.cc:460] Webserver started at http://127.28.92.190:41587/ using document root <none> and password file <none>
I20260809 00:50:59.680119 28114 fs_manager.cc:359] Metadata directory not provided
I20260809 00:50:59.680222 28114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:50:59.680540 28114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:50:59.683492 28114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "1070b235d3f94bcc9b67d95aea1a5f46"
format_stamp: "Formatted at 2026-08-09 00:50:59 on dist-test-slave-t7g5"
server_key: "ac7a38b9c45d9dffa4656a2c4d3de3c2"
server_key_iv: "fe4a0cbdc7d18bf0ce6487343512f3de"
server_key_version: "encryptionkey@0"
I20260809 00:50:59.684346 28114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "1070b235d3f94bcc9b67d95aea1a5f46"
format_stamp: "Formatted at 2026-08-09 00:50:59 on dist-test-slave-t7g5"
server_key: "ac7a38b9c45d9dffa4656a2c4d3de3c2"
server_key_iv: "fe4a0cbdc7d18bf0ce6487343512f3de"
server_key_version: "encryptionkey@0"
I20260809 00:50:59.689421 28114 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:50:59.692875 28140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:50:59.694267 28114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:50:59.694442 28114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "1070b235d3f94bcc9b67d95aea1a5f46"
format_stamp: "Formatted at 2026-08-09 00:50:59 on dist-test-slave-t7g5"
server_key: "ac7a38b9c45d9dffa4656a2c4d3de3c2"
server_key_iv: "fe4a0cbdc7d18bf0ce6487343512f3de"
server_key_version: "encryptionkey@0"
I20260809 00:50:59.694649 28114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:50:59.722594 28114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:50:59.723528 28114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:50:59.723816 28114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:50:59.742214 28114 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:33325
I20260809 00:50:59.742235 28226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:33325 every 8 connection(s)
I20260809 00:50:59.743561 28114 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:50:59.747287 28227 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:50:59.748257 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 28114
I20260809 00:50:59.748448 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:50:59.749038 29042 external_mini_cluster.cc:1428] Setting key 86501293ee77b7d58e4f40066717c9e8
I20260809 00:50:59.761415 28227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46: Bootstrap starting.
I20260809 00:50:59.763042 28233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:50:59.751030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.28.92.190:33325)
0809 00:50:59.752066 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0809 00:50:59.752077 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:50:59.752121 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:50:59.753852 (+ 1731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:50:59.753877 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:50:59.754362 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:50:59.754722 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:50:59.755340 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:59.756618 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:59.758586 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:50:59.759308 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:50:59.759437 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:50:59.760693 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:50:59.760700 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:50:59.760714 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:50:59.761260 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:50:59.761341 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:50:59.761366 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:50:59.761456 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 00:50:59.761748 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 00:50:59.762100 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":372,"threads_started":1}
I20260809 00:50:59.764753 28227 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46: Neither blocks nor log segments found. Creating new log.
I20260809 00:50:59.765834 28227 log.cc:824] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46: Log is configured to *not* fsync() on all Append() calls
I20260809 00:50:59.768442 28227 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46: No bootstrap required, opened a new log
I20260809 00:50:59.775619 28227 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33325 } }
I20260809 00:50:59.775971 28227 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:50:59.776078 28227 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1070b235d3f94bcc9b67d95aea1a5f46, State: Initialized, Role: FOLLOWER
I20260809 00:50:59.776615 28227 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33325 } }
I20260809 00:50:59.776835 28227 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:50:59.776957 28227 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:50:59.777119 28227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:50:59.779384 28227 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33325 } }
I20260809 00:50:59.779894 28227 leader_election.cc:302] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1070b235d3f94bcc9b67d95aea1a5f46; no voters:
I20260809 00:50:59.780504 28227 leader_election.cc:288] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:50:59.780655 28235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:50:59.781637 28235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [term 1 LEADER]: Becoming Leader. State: Replica: 1070b235d3f94bcc9b67d95aea1a5f46, State: Running, Role: LEADER
I20260809 00:50:59.782228 28235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33325 } }
I20260809 00:50:59.782683 28227 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:50:59.784883 28237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33325 } } }
I20260809 00:50:59.784905 28238 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1070b235d3f94bcc9b67d95aea1a5f46. Latest consensus state: current_term: 1 leader_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1070b235d3f94bcc9b67d95aea1a5f46" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33325 } } }
I20260809 00:50:59.785353 28237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:59.785353 28238 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46 [sys.catalog]: This master's current role is: LEADER
I20260809 00:50:59.792200 28245 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:50:59.796569 28245 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:50:59.805150 28245 catalog_manager.cc:1347] Generated new cluster ID: 93a51c292c4d4dc1a2d758cdc888f591
I20260809 00:50:59.805261 28245 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:50:59.825722 28245 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:50:59.827682 28245 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:50:59.841212 28245 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46: Generated new TSK 0
I20260809 00:50:59.842350 28245 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:50:59.849740 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.129:0
--local_ip_for_outbound_sockets=127.28.92.129
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:33325
--builtin_ntp_servers=127.28.92.148:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 00:51:00.195569 28273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:00.195899 28273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:00.196035 28273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:00.203475 28273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:00.203588 28273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:00.203740 28273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.129
I20260809 00:51:00.212978 28273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.28.92.129
--webserver_port=0
--tserver_master_addrs=127.28.92.190:33325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.129
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:00.214345 28273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:00.216180 28273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:00.229307 28284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:00.229362 28287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:00.229297 28283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:00.230223 28273 server_base.cc:1034] running on GCE node
I20260809 00:51:00.230846 28273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:00.231774 28273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:00.232982 28273 hybrid_clock.cc:648] HybridClock initialized: now 1786236660232930 us; error 46 us; skew 500 ppm
I20260809 00:51:00.233296 28273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:51:00.235561 28273 webserver.cc:460] Webserver started at http://127.28.92.129:43933/ using document root <none> and password file <none>
I20260809 00:51:00.236253 28273 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:00.236361 28273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:00.236671 28273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:00.239624 28273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data/instance:
uuid: "aba904a922354f64acf3b22e3d3754c5"
format_stamp: "Formatted at 2026-08-09 00:51:00 on dist-test-slave-t7g5"
server_key: "f96feee317ff89834fdda9c2000cab8b"
server_key_iv: "d4d9f610a67c65c7cfef43c16e257899"
server_key_version: "encryptionkey@0"
I20260809 00:51:00.240422 28273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance:
uuid: "aba904a922354f64acf3b22e3d3754c5"
format_stamp: "Formatted at 2026-08-09 00:51:00 on dist-test-slave-t7g5"
server_key: "f96feee317ff89834fdda9c2000cab8b"
server_key_iv: "d4d9f610a67c65c7cfef43c16e257899"
server_key_version: "encryptionkey@0"
I20260809 00:51:00.245911 28273 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:51:00.249492 28301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:00.250813 28273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:00.250967 28273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal
uuid: "aba904a922354f64acf3b22e3d3754c5"
format_stamp: "Formatted at 2026-08-09 00:51:00 on dist-test-slave-t7g5"
server_key: "f96feee317ff89834fdda9c2000cab8b"
server_key_iv: "d4d9f610a67c65c7cfef43c16e257899"
server_key_version: "encryptionkey@0"
I20260809 00:51:00.251168 28273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:00.266211 28273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:00.267011 28273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:00.267297 28273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:00.268257 28273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:51:00.269730 28273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:51:00.269829 28273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:00.269937 28273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:51:00.270008 28273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:00.299489 28273 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.129:43419
I20260809 00:51:00.299531 28470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.129:43419 every 8 connection(s)
I20260809 00:51:00.300791 28273 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/data/info.pb
I20260809 00:51:00.302332 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 28273
I20260809 00:51:00.302493 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-0/wal/instance
I20260809 00:51:00.302907 29042 external_mini_cluster.cc:1428] Setting key d345c4c93dd5a3a965f783e82a2681a1
I20260809 00:51:00.305820 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.130:0
--local_ip_for_outbound_sockets=127.28.92.130
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:33325
--builtin_ntp_servers=127.28.92.148:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 00:51:00.313499 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:00.303342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:39267 (local address 127.28.92.190:33325)
0809 00:51:00.304068 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:00.304072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:00.305243 (+ 1171us) server_negotiation.cc:407] Connection header received
0809 00:51:00.307110 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:00.307117 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:00.307196 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:00.307308 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:00.308370 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.309312 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.310846 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.311366 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.311491 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:00.312727 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:00.312734 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:00.312738 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:00.312760 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:00.312813 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:00.312828 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:00.312912 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:00.313084 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 00:51:00.313177 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":490,"threads_started":1}
I20260809 00:51:00.314384 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:00.304039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:33325 (local address 127.28.92.129:39267)
0809 00:51:00.305072 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:00.305125 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:00.306845 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:00.307516 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:00.307524 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:00.307608 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:00.308201 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:00.308220 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.309439 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.309443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:00.310704 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:00.310718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.311557 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.311562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:00.311760 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:00.312432 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:51:00.312435 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:00.312473 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:51:00.312546 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:00.312914 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:00.312921 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:00.312927 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 00:51:00.313056 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 00:51:00.313335 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":309,"threads_started":1}
I20260809 00:51:00.315872 28471 heartbeater.cc:347] Connected to a master server at 127.28.92.190:33325
I20260809 00:51:00.316143 28471 heartbeater.cc:464] Registering TS with master...
I20260809 00:51:00.316875 28471 heartbeater.cc:511] Master 127.28.92.190:33325 requested a full tablet report, sending...
I20260809 00:51:00.318848 28168 ts_manager.cc:194] Registered new tserver with Master: aba904a922354f64acf3b22e3d3754c5 (127.28.92.129:43419)
I20260809 00:51:00.320307 28168 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.129:39267
W20260809 00:51:00.641305 28476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:00.641599 28476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:00.641747 28476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:00.648904 28476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:00.649005 28476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:00.649152 28476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.130
I20260809 00:51:00.658531 28476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.28.92.130
--webserver_port=0
--tserver_master_addrs=127.28.92.190:33325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.130
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:00.659834 28476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:00.661646 28476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:00.674499 28481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:00.674583 28485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:00.674541 28483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:00.675341 28476 server_base.cc:1034] running on GCE node
I20260809 00:51:00.676077 28476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:00.677093 28476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:00.678308 28476 hybrid_clock.cc:648] HybridClock initialized: now 1786236660678254 us; error 39 us; skew 500 ppm
I20260809 00:51:00.678617 28476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:51:00.681000 28476 webserver.cc:460] Webserver started at http://127.28.92.130:32809/ using document root <none> and password file <none>
I20260809 00:51:00.681725 28476 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:00.681838 28476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:00.682150 28476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:00.685165 28476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data/instance:
uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd"
format_stamp: "Formatted at 2026-08-09 00:51:00 on dist-test-slave-t7g5"
server_key: "8f3201cfb06e949235ed7d72a8c12ac7"
server_key_iv: "20e8a1f15ac3cdfd9384406199599e9f"
server_key_version: "encryptionkey@0"
I20260809 00:51:00.685981 28476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance:
uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd"
format_stamp: "Formatted at 2026-08-09 00:51:00 on dist-test-slave-t7g5"
server_key: "8f3201cfb06e949235ed7d72a8c12ac7"
server_key_iv: "20e8a1f15ac3cdfd9384406199599e9f"
server_key_version: "encryptionkey@0"
I20260809 00:51:00.690959 28476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260809 00:51:00.694489 28496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:00.695726 28476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:51:00.695891 28476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal
uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd"
format_stamp: "Formatted at 2026-08-09 00:51:00 on dist-test-slave-t7g5"
server_key: "8f3201cfb06e949235ed7d72a8c12ac7"
server_key_iv: "20e8a1f15ac3cdfd9384406199599e9f"
server_key_version: "encryptionkey@0"
I20260809 00:51:00.696089 28476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:00.715929 28476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:00.716696 28476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:00.716992 28476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:00.717923 28476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:51:00.719362 28476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:51:00.719457 28476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:00.719566 28476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:51:00.719640 28476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:00.750653 28476 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.130:41355
I20260809 00:51:00.750744 28668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.130:41355 every 8 connection(s)
I20260809 00:51:00.751905 28476 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/data/info.pb
I20260809 00:51:00.754966 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 28476
I20260809 00:51:00.755142 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal/instance
I20260809 00:51:00.755803 29042 external_mini_cluster.cc:1428] Setting key a5182be59a44beb81fc7575882eb00ed
I20260809 00:51:00.758683 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.28.92.131:0
--local_ip_for_outbound_sockets=127.28.92.131
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:33325
--builtin_ntp_servers=127.28.92.148:41895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 00:51:00.765695 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:00.754560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.130:36465 (local address 127.28.92.190:33325)
0809 00:51:00.754772 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:00.754779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:00.756864 (+ 2085us) server_negotiation.cc:407] Connection header received
0809 00:51:00.759314 (+ 2450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:00.759321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:00.759399 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:00.759503 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:00.760617 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.761612 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.763129 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.763650 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.763766 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:00.764970 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:00.764976 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:00.764980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:00.765002 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:00.765042 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:00.765057 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:00.765137 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:00.765311 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 00:51:00.765402 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 00:51:00.766577 28672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:00.755209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:33325 (local address 127.28.92.130:36465)
0809 00:51:00.756687 (+ 1478us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:00.756741 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:00.759021 (+ 2280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:00.759739 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:00.759751 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:00.759866 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:00.760448 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:00.760466 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.761775 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.761778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:00.762988 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:00.763000 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:00.763823 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:00.763828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:00.764038 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:00.764672 (+ 634us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:51:00.764675 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:00.764712 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:51:00.764790 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:00.765137 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:00.765144 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:00.765148 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 00:51:00.765272 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 00:51:00.765550 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":334,"threads_started":1}
I20260809 00:51:00.767804 28669 heartbeater.cc:347] Connected to a master server at 127.28.92.190:33325
I20260809 00:51:00.768123 28669 heartbeater.cc:464] Registering TS with master...
I20260809 00:51:00.768970 28669 heartbeater.cc:511] Master 127.28.92.190:33325 requested a full tablet report, sending...
I20260809 00:51:00.770470 28168 ts_manager.cc:194] Registered new tserver with Master: 46f04bdd83a2421bb4ddc9f30a44b1fd (127.28.92.130:41355)
I20260809 00:51:00.771450 28168 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.130:36465
W20260809 00:51:01.090503 28673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:01.090885 28673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:01.091028 28673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:01.100622 28673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:01.100732 28673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:01.100903 28673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.92.131
I20260809 00:51:01.110018 28673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:41895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.28.92.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.28.92.131
--webserver_port=0
--tserver_master_addrs=127.28.92.190:33325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.28.92.131
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:01.111235 28673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:01.112962 28673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:01.125313 28680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:01.125272 28679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:01.125352 28684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:01.126308 28673 server_base.cc:1034] running on GCE node
I20260809 00:51:01.126879 28673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:01.127758 28673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:01.128960 28673 hybrid_clock.cc:648] HybridClock initialized: now 1786236661128917 us; error 36 us; skew 500 ppm
I20260809 00:51:01.129263 28673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 00:51:01.131496 28673 webserver.cc:460] Webserver started at http://127.28.92.131:34169/ using document root <none> and password file <none>
I20260809 00:51:01.132144 28673 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:01.132246 28673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:01.132555 28673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:01.135335 28673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data/instance:
uuid: "4d661b8efaf945f09064da2a0842938d"
format_stamp: "Formatted at 2026-08-09 00:51:01 on dist-test-slave-t7g5"
server_key: "6022bb0a19d2e1b15e4b9f495b9a120c"
server_key_iv: "48859d110846d4a3752c8868dd161444"
server_key_version: "encryptionkey@0"
I20260809 00:51:01.136113 28673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance:
uuid: "4d661b8efaf945f09064da2a0842938d"
format_stamp: "Formatted at 2026-08-09 00:51:01 on dist-test-slave-t7g5"
server_key: "6022bb0a19d2e1b15e4b9f495b9a120c"
server_key_iv: "48859d110846d4a3752c8868dd161444"
server_key_version: "encryptionkey@0"
I20260809 00:51:01.141090 28673 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260809 00:51:01.144610 28694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:01.145948 28673 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:01.146101 28673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal
uuid: "4d661b8efaf945f09064da2a0842938d"
format_stamp: "Formatted at 2026-08-09 00:51:01 on dist-test-slave-t7g5"
server_key: "6022bb0a19d2e1b15e4b9f495b9a120c"
server_key_iv: "48859d110846d4a3752c8868dd161444"
server_key_version: "encryptionkey@0"
I20260809 00:51:01.146308 28673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:01.160437 28673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:01.161211 28673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:01.161492 28673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:01.162429 28673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 00:51:01.163827 28673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 00:51:01.163916 28673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:01.164027 28673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 00:51:01.164098 28673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:01.194129 28673 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.131:45189
I20260809 00:51:01.194173 28859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.131:45189 every 8 connection(s)
I20260809 00:51:01.195410 28673 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/data/info.pb
I20260809 00:51:01.199826 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 28673
I20260809 00:51:01.200049 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal/instance
I20260809 00:51:01.200603 29042 external_mini_cluster.cc:1428] Setting key 4a08912033f8cb9b7461b56371b03826
I20260809 00:51:01.208158 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.197897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.131:42485 (local address 127.28.92.190:33325)
0809 00:51:01.198081 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.198086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.199641 (+ 1555us) server_negotiation.cc:407] Connection header received
0809 00:51:01.201890 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.201896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.201971 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.202024 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:01.203600 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.204343 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.205878 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.206309 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.206411 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.207549 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:01.207553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:01.207557 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:01.207574 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:01.207606 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:01.207617 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:01.207681 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.207841 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.207918 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:51:01.209095 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.198526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:33325 (local address 127.28.92.131:42485)
0809 00:51:01.199462 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.199518 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:01.201546 (+ 2028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:01.202560 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:01.202572 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:01.202682 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:01.203257 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.203275 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.204475 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.204479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.205747 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.205759 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.206486 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.206490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.206678 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.207268 (+ 590us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 00:51:01.207270 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:01.207308 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 00:51:01.207383 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:01.207685 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:01.207690 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:01.207695 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 00:51:01.207824 (+ 129us) client_negotiation.cc:240] Negotiation successful
0809 00:51:01.208101 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":280,"threads_started":1}
I20260809 00:51:01.210325 28860 heartbeater.cc:347] Connected to a master server at 127.28.92.190:33325
I20260809 00:51:01.210623 28860 heartbeater.cc:464] Registering TS with master...
I20260809 00:51:01.211391 28860 heartbeater.cc:511] Master 127.28.92.190:33325 requested a full tablet report, sending...
I20260809 00:51:01.212770 28168 ts_manager.cc:194] Registered new tserver with Master: 4d661b8efaf945f09064da2a0842938d (127.28.92.131:45189)
I20260809 00:51:01.213587 28168 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.28.92.131:42485
I20260809 00:51:01.215860 29042 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 00:51:01.225535 28473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.220063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48204 (local address 127.28.92.190:33325)
0809 00:51:01.220226 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.220231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.220671 (+ 440us) server_negotiation.cc:407] Connection header received
0809 00:51:01.220867 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.220871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.220956 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.221047 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:01.221493 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.222244 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.223532 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.223945 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.224037 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.224939 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:01.224944 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:01.224947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:01.224964 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:01.224997 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:01.225009 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:01.225074 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.225214 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.225290 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 00:51:01.229112 28168 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 00:51:01.235936 28168 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 00:51:01.270375 28884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.249613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:41355 (local address 127.0.0.1:34458)
0809 00:51:01.262494 (+ 12881us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.262515 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:01.262650 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:01.263554 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:01.263562 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:01.263594 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:51:01.264065 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.264080 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.265789 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.265795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.268051 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.268065 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.269338 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.269344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.269547 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.269601 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 00:51:01.269753 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 00:51:01.269954 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12750,"mutex_wait_us":31,"thread_start_us":13094,"threads_started":1}
I20260809 00:51:01.271320 28886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.260818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34458 (local address 127.28.92.130:41355)
0809 00:51:01.261477 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.261487 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.262773 (+ 1286us) server_negotiation.cc:407] Connection header received
0809 00:51:01.262886 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.262893 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.263092 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.263257 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:51:01.264323 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.265644 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.268218 (+ 2574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.269143 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.269263 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.269575 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.270883 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.271081 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":686,"threads_started":1}
I20260809 00:51:01.272007 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.247810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:36978)
0809 00:51:01.248881 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.248955 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:01.249236 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:01.264799 (+ 15563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:01.264804 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:01.264829 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:51:01.265201 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.265213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.267063 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.267072 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.268576 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.268589 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.271316 (+ 2727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.271322 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.271499 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.271533 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 00:51:01.271599 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 00:51:01.271722 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":2129,"threads_started":1}
I20260809 00:51:01.273031 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.248285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36978 (local address 127.28.92.129:43419)
0809 00:51:01.264244 (+ 15959us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.264251 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.264281 (+ 30us) server_negotiation.cc:407] Connection header received
0809 00:51:01.264371 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.264378 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.264600 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.264805 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:51:01.265406 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.266899 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.269712 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.271096 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.272230 (+ 1134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.272463 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.272534 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.272691 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15816,"thread_start_us":15710,"threads_started":1}
I20260809 00:51:01.273478 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.247850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45189 (local address 127.0.0.1:58878)
0809 00:51:01.250065 (+ 2215us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.250085 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:01.250244 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:01.264095 (+ 13851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:01.264100 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:01.264129 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:51:01.264456 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.264467 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.266479 (+ 2012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.266485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.269436 (+ 2951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.269446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.272713 (+ 3267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.272719 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.272896 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.272927 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 00:51:01.273011 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 00:51:01.273135 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2005,"mutex_wait_us":1207,"thread_start_us":355,"threads_started":1}
I20260809 00:51:01.273571 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.248917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58878 (local address 127.28.92.131:45189)
0809 00:51:01.261712 (+ 12795us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.261721 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.261764 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:51:01.261889 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.261899 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.262231 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.262461 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:51:01.264657 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.266307 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.270260 (+ 3953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.272528 (+ 2268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.272646 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.272905 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.273065 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.273218 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12607,"thread_start_us":12460,"threads_started":1}
I20260809 00:51:01.275429 28573 tablet_service.cc:1467] Processing CreateTablet for tablet fd2c719f4aab44039c03c99928f8e4e7 (DEFAULT_TABLE table=test-table [id=b140f11585074b2085729e198684a618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:51:01.276844 28573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2c719f4aab44039c03c99928f8e4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:01.276610 28374 tablet_service.cc:1467] Processing CreateTablet for tablet fd2c719f4aab44039c03c99928f8e4e7 (DEFAULT_TABLE table=test-table [id=b140f11585074b2085729e198684a618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:51:01.277760 28374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2c719f4aab44039c03c99928f8e4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:01.278581 28766 tablet_service.cc:1467] Processing CreateTablet for tablet fd2c719f4aab44039c03c99928f8e4e7 (DEFAULT_TABLE table=test-table [id=b140f11585074b2085729e198684a618]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 00:51:01.279979 28766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd2c719f4aab44039c03c99928f8e4e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:01.288805 28887 tablet_bootstrap.cc:492] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5: Bootstrap starting.
I20260809 00:51:01.291203 28889 tablet_bootstrap.cc:492] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Bootstrap starting.
I20260809 00:51:01.293175 28887 tablet_bootstrap.cc:654] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:01.294476 28887 log.cc:824] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:01.294625 28889 tablet_bootstrap.cc:654] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:01.295832 28889 log.cc:824] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:01.295943 28890 tablet_bootstrap.cc:492] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Bootstrap starting.
I20260809 00:51:01.297679 28887 tablet_bootstrap.cc:492] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5: No bootstrap required, opened a new log
I20260809 00:51:01.297983 28887 ts_tablet_manager.cc:1397] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260809 00:51:01.299216 28890 tablet_bootstrap.cc:654] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:01.299377 28889 tablet_bootstrap.cc:492] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: No bootstrap required, opened a new log
I20260809 00:51:01.299639 28889 ts_tablet_manager.cc:1397] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 00:51:01.300431 28890 log.cc:824] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:01.308689 28887 raft_consensus.cc:348] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.309135 28887 raft_consensus.cc:374] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:01.309233 28887 raft_consensus.cc:729] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba904a922354f64acf3b22e3d3754c5, State: Initialized, Role: FOLLOWER
I20260809 00:51:01.309980 28887 consensus_queue.cc:260] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.310442 28889 raft_consensus.cc:348] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.310884 28889 raft_consensus.cc:374] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:01.310990 28889 raft_consensus.cc:729] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f04bdd83a2421bb4ddc9f30a44b1fd, State: Initialized, Role: FOLLOWER
I20260809 00:51:01.312040 28889 consensus_queue.cc:260] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.313820 28887 ts_tablet_manager.cc:1428] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5: Time spent starting tablet: real 0.016s user 0.013s sys 0.002s
I20260809 00:51:01.315001 28890 tablet_bootstrap.cc:492] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: No bootstrap required, opened a new log
I20260809 00:51:01.315310 28890 ts_tablet_manager.cc:1397] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.004s
I20260809 00:51:01.315349 28471 heartbeater.cc:503] Master 127.28.92.190:33325 was elected leader, sending a full tablet report...
I20260809 00:51:01.317258 28669 heartbeater.cc:503] Master 127.28.92.190:33325 was elected leader, sending a full tablet report...
I20260809 00:51:01.318044 28889 ts_tablet_manager.cc:1428] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Time spent starting tablet: real 0.018s user 0.009s sys 0.008s
I20260809 00:51:01.324718 28890 raft_consensus.cc:348] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.325222 28890 raft_consensus.cc:374] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:01.325315 28890 raft_consensus.cc:729] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d661b8efaf945f09064da2a0842938d, State: Initialized, Role: FOLLOWER
I20260809 00:51:01.325822 28890 consensus_queue.cc:260] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.326707 28860 heartbeater.cc:503] Master 127.28.92.190:33325 was elected leader, sending a full tablet report...
I20260809 00:51:01.327272 28890 ts_tablet_manager.cc:1428] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Time spent starting tablet: real 0.012s user 0.007s sys 0.003s
I20260809 00:51:01.366343 28896 raft_consensus.cc:482] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 00:51:01.366643 28896 raft_consensus.cc:504] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.368366 28896 leader_election.cc:288] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d661b8efaf945f09064da2a0842938d (127.28.92.131:45189), 46f04bdd83a2421bb4ddc9f30a44b1fd (127.28.92.130:41355)
I20260809 00:51:01.377132 28886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.368797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:47929 (local address 127.28.92.130:41355)
0809 00:51:01.369010 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.369016 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.369711 (+ 695us) server_negotiation.cc:407] Connection header received
0809 00:51:01.369918 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.369923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.370005 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.370093 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:51:01.370869 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.371950 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.374860 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.376066 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.376220 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.376292 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.376740 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.376870 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 00:51:01.377132 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.368831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.28.92.129:38949 (local address 127.28.92.131:45189)
0809 00:51:01.369010 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.369017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.369701 (+ 684us) server_negotiation.cc:407] Connection header received
0809 00:51:01.369903 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.369909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.370001 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.370099 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 00:51:01.370887 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.371962 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.374857 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.376069 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.376241 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.376300 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.376740 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.376870 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 00:51:01.377327 28901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.368741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.130:41355 (local address 127.28.92.129:47929)
0809 00:51:01.369597 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.369610 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:01.369796 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:01.370140 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:01.370145 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:01.370177 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:51:01.370670 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.370689 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.372077 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.372082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.374651 (+ 2569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.374667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.376276 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.376282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.376515 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.376597 (+ 82us) client_negotiation.cc:769] Sending connection context
0809 00:51:01.376690 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 00:51:01.376889 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"mutex_wait_us":296,"spinlock_wait_cycles":22400,"thread_start_us":488,"threads_started":1}
I20260809 00:51:01.377676 28899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.368635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.131:45189 (local address 127.28.92.129:38949)
0809 00:51:01.369549 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.369568 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:01.369757 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:01.370140 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:01.370145 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:01.370197 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 00:51:01.370761 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.370771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.372074 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.372079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.374652 (+ 2573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:01.374667 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.376253 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.376264 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:01.376532 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.376601 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 00:51:01.376691 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 00:51:01.376879 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":295,"spinlock_wait_cycles":33664,"thread_start_us":554,"threads_started":1}
I20260809 00:51:01.378391 28603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2c719f4aab44039c03c99928f8e4e7" candidate_uuid: "aba904a922354f64acf3b22e3d3754c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" is_pre_election: true
I20260809 00:51:01.378624 28795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2c719f4aab44039c03c99928f8e4e7" candidate_uuid: "aba904a922354f64acf3b22e3d3754c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d661b8efaf945f09064da2a0842938d" is_pre_election: true
I20260809 00:51:01.379005 28603 raft_consensus.cc:2454] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba904a922354f64acf3b22e3d3754c5 in term 0.
I20260809 00:51:01.379158 28795 raft_consensus.cc:2454] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba904a922354f64acf3b22e3d3754c5 in term 0.
I20260809 00:51:01.379722 28307 leader_election.cc:302] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46f04bdd83a2421bb4ddc9f30a44b1fd, aba904a922354f64acf3b22e3d3754c5; no voters:
I20260809 00:51:01.380082 28896 raft_consensus.cc:2781] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 00:51:01.380236 28896 raft_consensus.cc:482] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 00:51:01.380352 28896 raft_consensus.cc:3037] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:01.382557 28896 raft_consensus.cc:504] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.383190 28896 leader_election.cc:288] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [CANDIDATE]: Term 1 election: Requested vote from peers 4d661b8efaf945f09064da2a0842938d (127.28.92.131:45189), 46f04bdd83a2421bb4ddc9f30a44b1fd (127.28.92.130:41355)
I20260809 00:51:01.383546 28795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2c719f4aab44039c03c99928f8e4e7" candidate_uuid: "aba904a922354f64acf3b22e3d3754c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d661b8efaf945f09064da2a0842938d"
I20260809 00:51:01.383731 28795 raft_consensus.cc:3037] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:01.383881 28603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd2c719f4aab44039c03c99928f8e4e7" candidate_uuid: "aba904a922354f64acf3b22e3d3754c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd"
I20260809 00:51:01.384102 28603 raft_consensus.cc:3037] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:01.386974 28795 raft_consensus.cc:2454] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba904a922354f64acf3b22e3d3754c5 in term 1.
I20260809 00:51:01.387207 28603 raft_consensus.cc:2454] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba904a922354f64acf3b22e3d3754c5 in term 1.
I20260809 00:51:01.387394 28303 leader_election.cc:302] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d661b8efaf945f09064da2a0842938d, aba904a922354f64acf3b22e3d3754c5; no voters:
I20260809 00:51:01.387754 28896 raft_consensus.cc:2781] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:01.388263 28896 raft_consensus.cc:686] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [term 1 LEADER]: Becoming Leader. State: Replica: aba904a922354f64acf3b22e3d3754c5, State: Running, Role: LEADER
I20260809 00:51:01.388742 28896 consensus_queue.cc:237] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } }
I20260809 00:51:01.393093 28166 catalog_manager.cc:5495] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to aba904a922354f64acf3b22e3d3754c5 (127.28.92.129). New cstate: current_term: 1 leader_uuid: "aba904a922354f64acf3b22e3d3754c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba904a922354f64acf3b22e3d3754c5" member_type: VOTER last_known_addr { host: "127.28.92.129" port: 43419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 } health_report { overall_health: UNKNOWN } } }
I20260809 00:51:01.429669 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.424269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36980 (local address 127.28.92.129:43419)
0809 00:51:01.424491 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.424497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.424518 (+ 21us) server_negotiation.cc:407] Connection header received
0809 00:51:01.424708 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.424712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.424820 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.424950 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:01.425348 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.426096 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.427454 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.427876 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.427984 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.428465 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:01.428955 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:01.429086 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.429196 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.429284 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:51:01.437275 28603 raft_consensus.cc:1261] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 1 FOLLOWER]: Refusing update from remote peer aba904a922354f64acf3b22e3d3754c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:51:01.437289 28795 raft_consensus.cc:1261] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 1 FOLLOWER]: Refusing update from remote peer aba904a922354f64acf3b22e3d3754c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:51:01.438198 28903 consensus_queue.cc:1035] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f04bdd83a2421bb4ddc9f30a44b1fd" member_type: VOTER last_known_addr { host: "127.28.92.130" port: 41355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:51:01.438508 28896 consensus_queue.cc:1035] T fd2c719f4aab44039c03c99928f8e4e7 P aba904a922354f64acf3b22e3d3754c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d661b8efaf945f09064da2a0842938d" member_type: VOTER last_known_addr { host: "127.28.92.131" port: 45189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 00:51:01.446967 28861 tablet.cc:2369] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:51:01.454403 28907 mvcc.cc:205] Tried to move back new op lower bound from 7316425365238075392 to 7316425365052542976. Current Snapshot: MvccSnapshot[applied={T|T < 7316425365238075392}]
I20260809 00:51:01.463773 28168 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:51:01.464020 28168 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 00:51:01.467276 28168 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1070b235d3f94bcc9b67d95aea1a5f46: Sending DeleteTablet for 3 replicas of tablet fd2c719f4aab44039c03c99928f8e4e7
I20260809 00:51:01.468325 28374 tablet_service.cc:1514] Processing DeleteTablet for tablet fd2c719f4aab44039c03c99928f8e4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:51:01 UTC) from {username='slave'} at 127.0.0.1:36978
I20260809 00:51:01.468356 28766 tablet_service.cc:1514] Processing DeleteTablet for tablet fd2c719f4aab44039c03c99928f8e4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:51:01 UTC) from {username='slave'} at 127.0.0.1:58878
I20260809 00:51:01.468387 28573 tablet_service.cc:1514] Processing DeleteTablet for tablet fd2c719f4aab44039c03c99928f8e4e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 00:51:01 UTC) from {username='slave'} at 127.0.0.1:34458
I20260809 00:51:01.472013 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 28273
I20260809 00:51:01.487387 28922 tablet_replica.cc:330] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: stopping tablet replica
I20260809 00:51:01.487586 28920 tablet_replica.cc:330] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: stopping tablet replica
I20260809 00:51:01.487871 28922 raft_consensus.cc:2229] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:51:01.488114 28920 raft_consensus.cc:2229] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 00:51:01.488595 28922 raft_consensus.cc:2258] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:51:01.488742 28920 raft_consensus.cc:2258] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 00:51:01.489856 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.473015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36996 (local address 127.28.92.129:43419)
0809 00:51:01.473198 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.473204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.477242 (+ 4038us) server_negotiation.cc:407] Connection header received
0809 00:51:01.478036 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.478043 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.478144 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.478215 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:01.479297 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.480623 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.484510 (+ 3887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.485247 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.485362 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.487548 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:01.487559 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:01.487577 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:01.488358 (+ 781us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:01.488424 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:01.488448 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:01.488531 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.489345 (+ 814us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.489469 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:51:01.490931 28922 ts_tablet_manager.cc:1905] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:51:01.491155 28461 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:01.491127 28920 ts_tablet_manager.cc:1905] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 00:51:01.498518 28922 ts_tablet_manager.cc:1918] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:51:01.498536 28920 ts_tablet_manager.cc:1918] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 00:51:01.498701 28922 log.cc:1196] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-2/wal/wals/fd2c719f4aab44039c03c99928f8e4e7
I20260809 00:51:01.498982 28920 log.cc:1196] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Deleting WAL directory at /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786236336094448-29042-0/minicluster-data/ts-1/wal/wals/fd2c719f4aab44039c03c99928f8e4e7
I20260809 00:51:01.499454 28922 ts_tablet_manager.cc:1939] T fd2c719f4aab44039c03c99928f8e4e7 P 4d661b8efaf945f09064da2a0842938d: Deleting consensus metadata
I20260809 00:51:01.499748 28920 ts_tablet_manager.cc:1939] T fd2c719f4aab44039c03c99928f8e4e7 P 46f04bdd83a2421bb4ddc9f30a44b1fd: Deleting consensus metadata
I20260809 00:51:01.501618 28144 catalog_manager.cc:4841] TS 4d661b8efaf945f09064da2a0842938d (127.28.92.131:45189): tablet fd2c719f4aab44039c03c99928f8e4e7 (table test-table [id=b140f11585074b2085729e198684a618]) successfully deleted
I20260809 00:51:01.501709 28146 catalog_manager.cc:4841] TS 46f04bdd83a2421bb4ddc9f30a44b1fd (127.28.92.130:41355): tablet fd2c719f4aab44039c03c99928f8e4e7 (table test-table [id=b140f11585074b2085729e198684a618]) successfully deleted
I20260809 00:51:01.597149 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 28273
I20260809 00:51:01.620935 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 28476
W20260809 00:51:01.620891 28145 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.28.92.129:43419 (error 108)
I20260809 00:51:01.622814 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.622358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37012)
0809 00:51:01.622554 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.622672 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260809 00:51:01.623078 28145 catalog_manager.cc:4584] TS aba904a922354f64acf3b22e3d3754c5 (127.28.92.129:43419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fd2c719f4aab44039c03c99928f8e4e7: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
I20260809 00:51:01.628353 28886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.621827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34466 (local address 127.28.92.130:41355)
0809 00:51:01.622000 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.622006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.622065 (+ 59us) server_negotiation.cc:407] Connection header received
0809 00:51:01.622254 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.622259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.622342 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.622433 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:01.623383 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.624115 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.625344 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.625894 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.626039 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.627033 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:01.627042 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:01.627057 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:01.627624 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:01.627676 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:01.627697 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:01.627796 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.627937 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.628048 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:51:01.629014 28662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:01.676649 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.676173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37022)
0809 00:51:01.676392 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.676483 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 00:51:01.677760 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.677391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37028)
0809 00:51:01.677515 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.677591 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 00:51:01.717133 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 28476
I20260809 00:51:01.738565 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.737938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37040)
0809 00:51:01.738182 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.738299 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 00:51:01.738977 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 28673
I20260809 00:51:01.739634 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.739256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37052)
0809 00:51:01.739411 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.739490 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 00:51:01.748829 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.739691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58890 (local address 127.28.92.131:45189)
0809 00:51:01.739853 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:01.739858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:01.739875 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:51:01.740055 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:01.740059 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:01.740149 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:01.740248 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:01.740592 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.741300 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.742633 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:01.743039 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:01.743157 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:01.747490 (+ 4333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:01.747501 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:01.747519 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:01.748096 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:01.748145 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:01.748167 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:01.748281 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:01.748419 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 00:51:01.748540 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:51:01.749449 28855 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:01.820232 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.819775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37054)
0809 00:51:01.819988 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.820081 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 00:51:01.821281 28880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:01.820881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.129:43419 (local address 127.0.0.1:37058)
0809 00:51:01.821098 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:01.821171 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.129:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260809 00:51:01.836853 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 28673
I20260809 00:51:01.858700 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 28114
I20260809 00:51:01.859838 28221 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:01.969519 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 28114
2026-08-09T00:51:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2766 ms)
[----------] 6 tests from EncryptionPolicyTest (22229 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:02 dist-test-slave-t7g5 krb5kdc[28941](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:02 dist-test-slave-t7g5 krb5kdc[28941](info): set up 2 sockets
Aug 09 00:51:02 dist-test-slave-t7g5 krb5kdc[28941](info): commencing operation
krb5kdc: starting...
W20260809 00:51:03.226945 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.002s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:03 dist-test-slave-t7g5 krb5kdc[28941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:03.531373 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37517
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:03.868590 28961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:03.868897 28961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:03.869038 28961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:03.876320 28961 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:03.876441 28961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:03.876535 28961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:03.876623 28961 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:03.876688 28961 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:03.886656 28961 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37517
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:03.888000 28961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:03.889321 28961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:03.901597 28969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:03.901634 28974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:03.901688 28970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:03.902814 28961 server_base.cc:1034] running on GCE node
I20260809 00:51:03.903622 28961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:03.905109 28961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:03.906320 28961 hybrid_clock.cc:648] HybridClock initialized: now 1786236663906279 us; error 41 us; skew 500 ppm
I20260809 00:51:03.906689 28961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:03 dist-test-slave-t7g5 krb5kdc[28941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236663, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:03.910156 28961 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:03.911722 28961 webserver.cc:460] Webserver started at http://127.0.0.1:43433/ using document root <none> and password file <none>
I20260809 00:51:03.912442 28961 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:03.912586 28961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:03.912914 28961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:03.916184 28961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "053f0cfefbbe41f6b91aebf2bea02c64"
format_stamp: "Formatted at 2026-08-09 00:51:03 on dist-test-slave-t7g5"
server_key: "a8de3adee77612036089dbeda019286f"
server_key_iv: "5d26919d18131a9faf64d198209086be"
server_key_version: "encryptionkey@0"
I20260809 00:51:03.917034 28961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "053f0cfefbbe41f6b91aebf2bea02c64"
format_stamp: "Formatted at 2026-08-09 00:51:03 on dist-test-slave-t7g5"
server_key: "a8de3adee77612036089dbeda019286f"
server_key_iv: "5d26919d18131a9faf64d198209086be"
server_key_version: "encryptionkey@0"
I20260809 00:51:03.922706 28961 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:51:03.926362 28983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:03.927739 28961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:51:03.927927 28961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "053f0cfefbbe41f6b91aebf2bea02c64"
format_stamp: "Formatted at 2026-08-09 00:51:03 on dist-test-slave-t7g5"
server_key: "a8de3adee77612036089dbeda019286f"
server_key_iv: "5d26919d18131a9faf64d198209086be"
server_key_version: "encryptionkey@0"
I20260809 00:51:03.928118 28961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:03.944592 28961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:03.948948 28961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:03.949229 28961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:03.967224 28961 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37517
I20260809 00:51:03.967255 29077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37517 every 8 connection(s)
I20260809 00:51:03.968546 28961 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:03.970036 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 28961
I20260809 00:51:03.970290 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:03.971172 29042 external_mini_cluster.cc:1428] Setting key 82f410f4cd5c38294aa3f1c78a330245
I20260809 00:51:03.973168 29078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 00:51:03 dist-test-slave-t7g5 krb5kdc[28941](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 00:51:03.986730 29078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64: Bootstrap starting.
I20260809 00:51:03.990034 29078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:03.991308 29078 log.cc:824] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:03.994571 29078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64: No bootstrap required, opened a new log
I20260809 00:51:03.994815 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:03.973149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47217 (local address 127.0.0.1:37517)
0809 00:51:03.973990 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:03.974001 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:03.974042 (+ 41us) server_negotiation.cc:407] Connection header received
0809 00:51:03.975693 (+ 1651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:03.975715 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:03.976091 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:03.976423 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:03.978209 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:03.979582 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:03.981329 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:03.982023 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:03.982144 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:03.987113 (+ 4969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:03.987121 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:03.987136 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:03.987176 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:03.990242 (+ 3066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:03.991221 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:03.991230 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:03.991240 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:03.991423 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:03.991973 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:03.991978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:03.991981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:03.992726 (+ 745us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:03.992980 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:03.993462 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 00:51:03.993772 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":397,"threads_started":1}
I20260809 00:51:03.998858 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:04.004518 29078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37517 } }
I20260809 00:51:04.004933 29078 raft_consensus.cc:374] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:04.005038 29078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 053f0cfefbbe41f6b91aebf2bea02c64, State: Initialized, Role: FOLLOWER
I20260809 00:51:04.005705 29078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37517 } }
I20260809 00:51:04.005972 29078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:04.006103 29078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:04.006259 29078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:04.009022 29078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37517 } }
I20260809 00:51:04.009549 29078 leader_election.cc:302] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 053f0cfefbbe41f6b91aebf2bea02c64; no voters:
I20260809 00:51:04.010263 29078 leader_election.cc:288] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:04.010396 29094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:04.011396 29094 raft_consensus.cc:686] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [term 1 LEADER]: Becoming Leader. State: Replica: 053f0cfefbbe41f6b91aebf2bea02c64, State: Running, Role: LEADER
I20260809 00:51:04.011940 29094 consensus_queue.cc:237] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37517 } }
I20260809 00:51:04.012645 29078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:04.014575 29095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37517 } } }
I20260809 00:51:04.014951 29095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:04.015548 29096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 053f0cfefbbe41f6b91aebf2bea02c64. Latest consensus state: current_term: 1 leader_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "053f0cfefbbe41f6b91aebf2bea02c64" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37517 } } }
I20260809 00:51:04.015868 29096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:04.017967 29106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:04.021723 29084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:04.004460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51471 (local address 127.0.0.1:37517)
0809 00:51:04.004642 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:04.004647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:04.005054 (+ 407us) server_negotiation.cc:407] Connection header received
0809 00:51:04.005225 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:04.005230 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:04.005318 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:04.005428 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:04.007082 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:04.008252 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:04.009513 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:04.010176 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:04.010332 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:04.013632 (+ 3300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:04.013638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:04.013644 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:04.013701 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:04.017778 (+ 4077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:04.018739 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:04.018745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:04.018749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:04.019093 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:04.019787 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:04.019792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:04.019796 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:04.020232 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:04.020669 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:04.021084 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 00:51:04.021290 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:51:04.027842 29106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:04.036522 29106 catalog_manager.cc:1347] Generated new cluster ID: 9c6a067265f64743880010d5df0cca6b
I20260809 00:51:04.036650 29106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:04.056034 29106 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:04.057377 29106 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:04.066885 29106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 053f0cfefbbe41f6b91aebf2bea02c64: Generated new TSK 0
I20260809 00:51:04.068049 29106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:04.082363 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 28961
I20260809 00:51:04.083740 29072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:04.175588 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 28961
W20260809 00:51:04.200757 28938 connection.cc:535] client connection to 127.0.0.1:37517 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37517): Connection reset by peer (error 104)
2026-08-09T00:51:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2197 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:04 dist-test-slave-t7g5 krb5kdc[29131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:04 dist-test-slave-t7g5 krb5kdc[29131](info): set up 2 sockets
Aug 09 00:51:04 dist-test-slave-t7g5 krb5kdc[29131](info): commencing operation
krb5kdc: starting...
W20260809 00:51:05.407111 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.188s user 0.005s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:05 dist-test-slave-t7g5 krb5kdc[29131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:05.708770 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36349
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36349
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:06.056609 29147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:06.056962 29147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:06.057111 29147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:06.064558 29147 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:06.064707 29147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:06.064798 29147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:06.064882 29147 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:06.064945 29147 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:06.075134 29147 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36349
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36349
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:06.076540 29147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:06.077919 29147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:06.089520 29155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:06.089455 29156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:06.089497 29158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:06.090569 29147 server_base.cc:1034] running on GCE node
I20260809 00:51:06.091374 29147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:06.092772 29147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:06.093993 29147 hybrid_clock.cc:648] HybridClock initialized: now 1786236666093951 us; error 30 us; skew 500 ppm
I20260809 00:51:06.094337 29147 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:06 dist-test-slave-t7g5 krb5kdc[29131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236666, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:06.097533 29147 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:06.099016 29147 webserver.cc:460] Webserver started at http://127.0.0.1:45169/ using document root <none> and password file <none>
I20260809 00:51:06.099682 29147 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:06.099812 29147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:06.100119 29147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:06.103827 29147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "a1844a6bde034adfb39516d444b4c034"
format_stamp: "Formatted at 2026-08-09 00:51:06 on dist-test-slave-t7g5"
server_key: "cba30d5527fdae269870b7fb0e7ef334"
server_key_iv: "ada0b3363db31caaddc6c60fe4014b4d"
server_key_version: "encryptionkey@0"
I20260809 00:51:06.104871 29147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "a1844a6bde034adfb39516d444b4c034"
format_stamp: "Formatted at 2026-08-09 00:51:06 on dist-test-slave-t7g5"
server_key: "cba30d5527fdae269870b7fb0e7ef334"
server_key_iv: "ada0b3363db31caaddc6c60fe4014b4d"
server_key_version: "encryptionkey@0"
I20260809 00:51:06.112540 29147 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.004s
I20260809 00:51:06.116601 29169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:06.118048 29147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:06.118222 29147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "a1844a6bde034adfb39516d444b4c034"
format_stamp: "Formatted at 2026-08-09 00:51:06 on dist-test-slave-t7g5"
server_key: "cba30d5527fdae269870b7fb0e7ef334"
server_key_iv: "ada0b3363db31caaddc6c60fe4014b4d"
server_key_version: "encryptionkey@0"
I20260809 00:51:06.118417 29147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:06.129628 29147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:06.133900 29147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:06.134178 29147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:06.152598 29147 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36349
I20260809 00:51:06.152633 29234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36349 every 8 connection(s)
I20260809 00:51:06.154035 29147 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:06.157889 29235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:06.158332 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29147
I20260809 00:51:06.158502 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:06.158943 29042 external_mini_cluster.cc:1428] Setting key e189277f0dd7840cb25a9dd12454d91e
I20260809 00:51:06.171204 29235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034: Bootstrap starting.
I20260809 00:51:06.172961 29240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:06.160624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45791 (local address 127.0.0.1:36349)
0809 00:51:06.161433 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:06.161444 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:06.161484 (+ 40us) server_negotiation.cc:407] Connection header received
0809 00:51:06.163786 (+ 2302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:06.163825 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:06.164235 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:06.164563 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:06.165205 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:06.166550 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:06.168463 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:06.169190 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:06.169326 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:06.170676 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:06.170684 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:06.170698 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:06.171250 (+ 552us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:06.171334 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:06.171369 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:06.171512 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:06.171763 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 00:51:06.171965 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":373,"threads_started":1}
I20260809 00:51:06.174778 29235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:06.175992 29235 log.cc:824] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:06.176880 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:06.178834 29235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034: No bootstrap required, opened a new log
I20260809 00:51:06.187903 29240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:06.181336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51193 (local address 127.0.0.1:36349)
0809 00:51:06.181529 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:06.181534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:06.181802 (+ 268us) server_negotiation.cc:407] Connection header received
0809 00:51:06.181981 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:06.181985 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:06.182048 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:06.182130 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:06.182738 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:06.183482 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:06.185316 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:06.185844 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:06.185942 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:06.187142 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:06.187147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:06.187151 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:06.187170 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:06.187242 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:06.187257 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:06.187346 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:06.187545 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 00:51:06.187589 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 00:51:06.188256 29235 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1844a6bde034adfb39516d444b4c034" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36349 } }
I20260809 00:51:06.188735 29235 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:06.188853 29235 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1844a6bde034adfb39516d444b4c034, State: Initialized, Role: FOLLOWER
I20260809 00:51:06.189568 29235 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1844a6bde034adfb39516d444b4c034" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36349 } }
I20260809 00:51:06.189906 29235 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:06.190069 29235 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:06.190248 29235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:06.193403 29235 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1844a6bde034adfb39516d444b4c034" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36349 } }
I20260809 00:51:06.193965 29235 leader_election.cc:302] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1844a6bde034adfb39516d444b4c034; no voters:
I20260809 00:51:06.194706 29235 leader_election.cc:288] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:06.194959 29250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:06.196578 29250 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [term 1 LEADER]: Becoming Leader. State: Replica: a1844a6bde034adfb39516d444b4c034, State: Running, Role: LEADER
I20260809 00:51:06.197145 29250 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1844a6bde034adfb39516d444b4c034" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36349 } }
I20260809 00:51:06.197470 29235 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:06.200138 29251 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1844a6bde034adfb39516d444b4c034" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1844a6bde034adfb39516d444b4c034" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36349 } } }
I20260809 00:51:06.200678 29251 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:06.200215 29252 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1844a6bde034adfb39516d444b4c034. Latest consensus state: current_term: 1 leader_uuid: "a1844a6bde034adfb39516d444b4c034" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1844a6bde034adfb39516d444b4c034" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36349 } } }
I20260809 00:51:06.200812 29252 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:06.202961 29259 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:06.208331 29259 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:06.219060 29259 catalog_manager.cc:1347] Generated new cluster ID: 98b0e76873fc4d9488f961925aff2a44
I20260809 00:51:06.219189 29259 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:06.233394 29259 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:06.234742 29259 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:06.249044 29259 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1844a6bde034adfb39516d444b4c034: Generated new TSK 0
I20260809 00:51:06.250000 29259 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:06.265434 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29147
W20260809 00:51:06.266866 29228 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:45791
W20260809 00:51:06.267666 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29147: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:06.267859 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29147
W20260809 00:51:06.294902 29129 connection.cc:535] client connection to 127.0.0.1:36349 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36349): Connection reset by peer (error 104)
2026-08-09T00:51:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2094 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:06 dist-test-slave-t7g5 krb5kdc[29287](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:06 dist-test-slave-t7g5 krb5kdc[29287](info): set up 2 sockets
Aug 09 00:51:06 dist-test-slave-t7g5 krb5kdc[29287](info): commencing operation
krb5kdc: starting...
W20260809 00:51:07.508381 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.005s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:07 dist-test-slave-t7g5 krb5kdc[29287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:07.802912 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41067
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:08.142695 29303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:08.143016 29303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:08.143146 29303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:08.150717 29303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:08.150849 29303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:08.150926 29303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:08.151005 29303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:08.151053 29303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:08.161396 29303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41067
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:08.162802 29303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:08.164115 29303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:08.175874 29311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:08.175812 29313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:08.176203 29310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:08.176977 29303 server_base.cc:1034] running on GCE node
I20260809 00:51:08.177779 29303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:08.179153 29303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:08.180354 29303 hybrid_clock.cc:648] HybridClock initialized: now 1786236668180311 us; error 36 us; skew 500 ppm
I20260809 00:51:08.180692 29303 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:08 dist-test-slave-t7g5 krb5kdc[29287](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236668, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:08.186959 29303 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:08.188503 29303 webserver.cc:460] Webserver started at http://127.0.0.1:46019/ using document root <none> and password file <none>
I20260809 00:51:08.189213 29303 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:08.189340 29303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:08.189682 29303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:08.193899 29303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "017f78b14da94933ad6f4fe0bd2501dd"
format_stamp: "Formatted at 2026-08-09 00:51:08 on dist-test-slave-t7g5"
server_key: "6a0ad9d78b4c350a2bf422f4fb24478c"
server_key_iv: "9a0f21ef7efeb6cf0947d8af77bcce84"
server_key_version: "encryptionkey@0"
I20260809 00:51:08.194841 29303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "017f78b14da94933ad6f4fe0bd2501dd"
format_stamp: "Formatted at 2026-08-09 00:51:08 on dist-test-slave-t7g5"
server_key: "6a0ad9d78b4c350a2bf422f4fb24478c"
server_key_iv: "9a0f21ef7efeb6cf0947d8af77bcce84"
server_key_version: "encryptionkey@0"
I20260809 00:51:08.200162 29303 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 00:51:08.203784 29320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:08.205108 29303 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:51:08.205272 29303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "017f78b14da94933ad6f4fe0bd2501dd"
format_stamp: "Formatted at 2026-08-09 00:51:08 on dist-test-slave-t7g5"
server_key: "6a0ad9d78b4c350a2bf422f4fb24478c"
server_key_iv: "9a0f21ef7efeb6cf0947d8af77bcce84"
server_key_version: "encryptionkey@0"
I20260809 00:51:08.205482 29303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:08.211283 29303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:08.215214 29303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:08.215504 29303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:08.232903 29303 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41067
I20260809 00:51:08.232985 29396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41067 every 8 connection(s)
I20260809 00:51:08.234318 29303 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:08.237970 29397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:08.242465 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29303
I20260809 00:51:08.242641 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:08.243039 29042 external_mini_cluster.cc:1428] Setting key 4020f3fda1661f2001de08ded10e6da6
I20260809 00:51:08.248960 29397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd: Bootstrap starting.
I20260809 00:51:08.250687 29401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:08.244757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43279 (local address 127.0.0.1:41067)
0809 00:51:08.245569 (+ 812us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:08.245583 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:08.245623 (+ 40us) server_negotiation.cc:407] Connection header received
0809 00:51:08.247455 (+ 1832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:08.247477 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:08.247785 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:08.248084 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:08.249155 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:08.249162 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:08.249176 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:08.249190 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:08.249255 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:08.249275 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:08.249450 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:08.249582 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 00:51:08.249768 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":352,"threads_started":1}
I20260809 00:51:08.252204 29397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:08.253360 29397 log.cc:824] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:08.254122 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:08.256373 29397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd: No bootstrap required, opened a new log
I20260809 00:51:08.261425 29401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:08.259137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53795 (local address 127.0.0.1:41067)
0809 00:51:08.259318 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:08.259324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:08.259691 (+ 367us) server_negotiation.cc:407] Connection header received
0809 00:51:08.259818 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:08.259826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:08.259886 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:08.259994 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:08.260798 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:08.260804 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:08.260809 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:08.260826 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:08.260875 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:08.260894 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:08.261005 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:08.261052 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 00:51:08.261111 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:51:08.265412 29397 raft_consensus.cc:348] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f78b14da94933ad6f4fe0bd2501dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260809 00:51:08.265796 29397 raft_consensus.cc:374] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:08.265885 29397 raft_consensus.cc:729] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 017f78b14da94933ad6f4fe0bd2501dd, State: Initialized, Role: FOLLOWER
I20260809 00:51:08.266399 29397 consensus_queue.cc:260] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f78b14da94933ad6f4fe0bd2501dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260809 00:51:08.266624 29397 raft_consensus.cc:388] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:08.266727 29397 raft_consensus.cc:482] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:08.266866 29397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:08.269333 29397 raft_consensus.cc:504] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f78b14da94933ad6f4fe0bd2501dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260809 00:51:08.269887 29397 leader_election.cc:302] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 017f78b14da94933ad6f4fe0bd2501dd; no voters:
I20260809 00:51:08.270413 29397 leader_election.cc:288] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:08.270529 29412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:08.271148 29412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [term 1 LEADER]: Becoming Leader. State: Replica: 017f78b14da94933ad6f4fe0bd2501dd, State: Running, Role: LEADER
I20260809 00:51:08.271632 29412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f78b14da94933ad6f4fe0bd2501dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } }
I20260809 00:51:08.272409 29397 sys_catalog.cc:564] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:08.274348 29413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "017f78b14da94933ad6f4fe0bd2501dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f78b14da94933ad6f4fe0bd2501dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } } }
I20260809 00:51:08.274752 29413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:08.278522 29414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 017f78b14da94933ad6f4fe0bd2501dd. Latest consensus state: current_term: 1 leader_uuid: "017f78b14da94933ad6f4fe0bd2501dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "017f78b14da94933ad6f4fe0bd2501dd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41067 } } }
I20260809 00:51:08.278857 29414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:08.282279 29421 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:08.288744 29421 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:08.297511 29421 catalog_manager.cc:1347] Generated new cluster ID: decd4b9820bf4ab4b4bfb39e0dceb913
I20260809 00:51:08.297670 29421 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:08.308136 29421 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:08.308588 29421 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:08.321148 29421 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 017f78b14da94933ad6f4fe0bd2501dd: Generated new TSK 0
I20260809 00:51:08.322285 29421 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:08.338876 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29303
W20260809 00:51:08.340052 29390 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43279
W20260809 00:51:08.340749 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29303: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:08.340907 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29303
2026-08-09T00:51:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2071 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:08 dist-test-slave-t7g5 krb5kdc[29447](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:08 dist-test-slave-t7g5 krb5kdc[29447](info): set up 2 sockets
Aug 09 00:51:08 dist-test-slave-t7g5 krb5kdc[29447](info): commencing operation
krb5kdc: starting...
W20260809 00:51:09.576953 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.003s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:09 dist-test-slave-t7g5 krb5kdc[29447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:09.873750 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44119
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:10.213320 29467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:10.213632 29467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:10.213814 29467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:10.221359 29467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:10.221489 29467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:10.221570 29467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:10.221683 29467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:10.221745 29467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:10.231885 29467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:10.233217 29467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:10.234618 29467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:10.246515 29478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:10.246490 29475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:10.246551 29474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:10.247416 29467 server_base.cc:1034] running on GCE node
I20260809 00:51:10.248199 29467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:10.249707 29467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:10.250922 29467 hybrid_clock.cc:648] HybridClock initialized: now 1786236670250860 us; error 45 us; skew 500 ppm
I20260809 00:51:10.251266 29467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:10 dist-test-slave-t7g5 krb5kdc[29447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236670, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:10.254377 29467 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:10.255882 29467 webserver.cc:460] Webserver started at http://127.0.0.1:42653/ using document root <none> and password file <none>
I20260809 00:51:10.256546 29467 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:10.256667 29467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:10.256978 29467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:10.260048 29467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "4e4c032ed46644a5aaffb0bf12f667f6"
format_stamp: "Formatted at 2026-08-09 00:51:10 on dist-test-slave-t7g5"
server_key: "df327621f4c6ac6bd37bb413f68f90c2"
server_key_iv: "fa3854f57e50b386c59da75601f9062b"
server_key_version: "encryptionkey@0"
I20260809 00:51:10.260811 29467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "4e4c032ed46644a5aaffb0bf12f667f6"
format_stamp: "Formatted at 2026-08-09 00:51:10 on dist-test-slave-t7g5"
server_key: "df327621f4c6ac6bd37bb413f68f90c2"
server_key_iv: "fa3854f57e50b386c59da75601f9062b"
server_key_version: "encryptionkey@0"
I20260809 00:51:10.265821 29467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:51:10.269124 29490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:10.270509 29467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:10.270697 29467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "4e4c032ed46644a5aaffb0bf12f667f6"
format_stamp: "Formatted at 2026-08-09 00:51:10 on dist-test-slave-t7g5"
server_key: "df327621f4c6ac6bd37bb413f68f90c2"
server_key_iv: "fa3854f57e50b386c59da75601f9062b"
server_key_version: "encryptionkey@0"
I20260809 00:51:10.270941 29467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:10.287861 29467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:10.291944 29467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:10.292234 29467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:10.311501 29467 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44119
I20260809 00:51:10.311520 29568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44119 every 8 connection(s)
I20260809 00:51:10.312994 29467 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:10.316780 29569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:10.320380 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29467
I20260809 00:51:10.320570 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:10.321035 29042 external_mini_cluster.cc:1428] Setting key f5185c0bdeec8641f9519e39dca5bae8
I20260809 00:51:10.329725 29569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6: Bootstrap starting.
I20260809 00:51:10.333591 29569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:10.334954 29569 log.cc:824] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6: Log is configured to *not* fsync() on all Append() calls
Aug 09 00:51:10 dist-test-slave-t7g5 krb5kdc[29447](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 00:51:10.338107 29569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6: No bootstrap required, opened a new log
I20260809 00:51:10.346164 29572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:10.322881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60811 (local address 127.0.0.1:44119)
0809 00:51:10.323738 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:10.323751 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:10.323796 (+ 45us) server_negotiation.cc:407] Connection header received
0809 00:51:10.325544 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:10.325568 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:10.326086 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:10.326444 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:10.328349 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:10.329849 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:10.331671 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:10.332418 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:10.332571 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:10.337405 (+ 4834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:10.337417 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:10.337437 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:10.337482 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:10.341462 (+ 3980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:10.342220 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:10.342229 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:10.342241 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:10.342462 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:10.342821 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:10.342825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:10.342828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:10.343539 (+ 711us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:10.343872 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:10.344184 (+ 312us) server_negotiation.cc:299] Negotiation successful
0809 00:51:10.344659 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":627,"thread_start_us":389,"threads_started":1}
I20260809 00:51:10.348662 29569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44119 } }
I20260809 00:51:10.349061 29569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:10.349172 29569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e4c032ed46644a5aaffb0bf12f667f6, State: Initialized, Role: FOLLOWER
I20260809 00:51:10.349817 29569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44119 } }
I20260809 00:51:10.350055 29569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:10.350193 29569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:10.350385 29569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:10.350430 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:10.352617 29569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44119 } }
I20260809 00:51:10.353127 29569 leader_election.cc:302] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e4c032ed46644a5aaffb0bf12f667f6; no voters:
I20260809 00:51:10.353819 29569 leader_election.cc:288] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:10.354020 29578 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:10.355185 29578 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [term 1 LEADER]: Becoming Leader. State: Replica: 4e4c032ed46644a5aaffb0bf12f667f6, State: Running, Role: LEADER
I20260809 00:51:10.355897 29578 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44119 } }
I20260809 00:51:10.356128 29569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:10.359004 29585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e4c032ed46644a5aaffb0bf12f667f6. Latest consensus state: current_term: 1 leader_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44119 } } }
I20260809 00:51:10.359552 29582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e4c032ed46644a5aaffb0bf12f667f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44119 } } }
I20260809 00:51:10.359895 29582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:10.360526 29585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:10.372182 29594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:10.379112 29594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:10.380672 29572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:10.357244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42827 (local address 127.0.0.1:44119)
0809 00:51:10.357411 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:10.357417 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:10.364350 (+ 6933us) server_negotiation.cc:407] Connection header received
0809 00:51:10.365341 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:10.365348 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:10.365462 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:10.365542 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:10.367898 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:10.368636 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:10.369989 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:10.370481 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:10.370595 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:10.373684 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:10.373691 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:10.373697 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:10.373740 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:10.377486 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:10.378354 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:10.378360 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:10.378363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:10.378525 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:10.378972 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:10.378977 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:10.378980 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:10.379447 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:10.379705 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:10.380078 (+ 373us) server_negotiation.cc:299] Negotiation successful
0809 00:51:10.380302 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 00:51:10.388537 29594 catalog_manager.cc:1347] Generated new cluster ID: a9b2b26dd11d42eb9fa0491a46fba590
I20260809 00:51:10.388662 29594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:10.414427 29594 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:10.415948 29594 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:10.427327 29594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e4c032ed46644a5aaffb0bf12f667f6: Generated new TSK 0
I20260809 00:51:10.428261 29594 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:10.437969 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29467
I20260809 00:51:10.439301 29561 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:10.531903 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29467
2026-08-09T00:51:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2190 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:10 dist-test-slave-t7g5 krb5kdc[29619](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:10 dist-test-slave-t7g5 krb5kdc[29619](info): set up 2 sockets
Aug 09 00:51:10 dist-test-slave-t7g5 krb5kdc[29619](info): commencing operation
krb5kdc: starting...
W20260809 00:51:11.764876 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:11 dist-test-slave-t7g5 krb5kdc[29619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:12.071194 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40705
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46435
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40705
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:12.422329 29642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:12.422633 29642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:12.422739 29642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:12.430263 29642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:12.430398 29642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:12.430476 29642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:12.430565 29642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:12.430624 29642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:12.440963 29642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46435
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:12.442428 29642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:12.443763 29642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:12.456229 29652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:12.456323 29657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:12.456251 29653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:12.457358 29642 server_base.cc:1034] running on GCE node
I20260809 00:51:12.458295 29642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:12.459908 29642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:12.461124 29642 hybrid_clock.cc:648] HybridClock initialized: now 1786236672461079 us; error 39 us; skew 500 ppm
I20260809 00:51:12.461514 29642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:12 dist-test-slave-t7g5 krb5kdc[29619](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236672, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:12.464812 29642 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:12.466495 29642 webserver.cc:460] Webserver started at http://127.0.0.1:33585/ using document root <none> and password file <none>
I20260809 00:51:12.467226 29642 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:12.467365 29642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:12.467679 29642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:12.471019 29642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "3c203339938244348f6c6e679902fadb"
format_stamp: "Formatted at 2026-08-09 00:51:12 on dist-test-slave-t7g5"
server_key: "6f380ace59be05d7419204c8eb49d6f8"
server_key_iv: "148260078510f5f95188dcb322eb0afb"
server_key_version: "encryptionkey@0"
I20260809 00:51:12.471818 29642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "3c203339938244348f6c6e679902fadb"
format_stamp: "Formatted at 2026-08-09 00:51:12 on dist-test-slave-t7g5"
server_key: "6f380ace59be05d7419204c8eb49d6f8"
server_key_iv: "148260078510f5f95188dcb322eb0afb"
server_key_version: "encryptionkey@0"
I20260809 00:51:12.477146 29642 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:51:12.480820 29672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:12.482191 29642 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:12.482400 29642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "3c203339938244348f6c6e679902fadb"
format_stamp: "Formatted at 2026-08-09 00:51:12 on dist-test-slave-t7g5"
server_key: "6f380ace59be05d7419204c8eb49d6f8"
server_key_iv: "148260078510f5f95188dcb322eb0afb"
server_key_version: "encryptionkey@0"
I20260809 00:51:12.482626 29642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:12.509366 29642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:12.514086 29642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:12.514431 29642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:12.534899 29642 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40705
I20260809 00:51:12.534934 29756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40705 every 8 connection(s)
I20260809 00:51:12.536536 29642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:12.540396 29757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:12.541371 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29642
I20260809 00:51:12.541570 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:12.542073 29042 external_mini_cluster.cc:1428] Setting key 451220e473942ffd6bb82ee2c163fcd2
I20260809 00:51:12.554646 29757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb: Bootstrap starting.
I20260809 00:51:12.556231 29763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:12.544092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32961 (local address 127.0.0.1:40705)
0809 00:51:12.545021 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:12.545033 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:12.545083 (+ 50us) server_negotiation.cc:407] Connection header received
0809 00:51:12.546932 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:12.546959 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:12.547435 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:12.547845 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:12.548453 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:12.549825 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:12.551690 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:12.552435 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:12.552573 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:12.553877 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:12.553885 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:12.553900 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:12.554460 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:12.554543 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:12.554580 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:12.554677 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:12.554937 (+ 260us) server_negotiation.cc:299] Negotiation successful
0809 00:51:12.555204 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":432,"threads_started":1}
I20260809 00:51:12.558082 29757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:12.559295 29757 log.cc:824] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:12.559957 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:12.562031 29757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb: No bootstrap required, opened a new log
I20260809 00:51:12.570751 29763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:12.564406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39163 (local address 127.0.0.1:40705)
0809 00:51:12.564600 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:12.564608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:12.564914 (+ 306us) server_negotiation.cc:407] Connection header received
0809 00:51:12.565049 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:12.565054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:12.565131 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:12.565244 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:12.565808 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:12.566882 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:12.568176 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:12.568859 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:12.569009 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:12.570034 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:12.570041 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:12.570045 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:12.570071 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:12.570119 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:12.570137 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:12.570227 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:12.570331 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 00:51:12.570426 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:51:12.571379 29757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c203339938244348f6c6e679902fadb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40705 } }
I20260809 00:51:12.571779 29757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:12.571885 29757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c203339938244348f6c6e679902fadb, State: Initialized, Role: FOLLOWER
I20260809 00:51:12.572507 29757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c203339938244348f6c6e679902fadb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40705 } }
I20260809 00:51:12.572741 29757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:12.572883 29757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:12.573043 29757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:12.575304 29757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c203339938244348f6c6e679902fadb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40705 } }
I20260809 00:51:12.575837 29757 leader_election.cc:302] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c203339938244348f6c6e679902fadb; no voters:
I20260809 00:51:12.576469 29757 leader_election.cc:288] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:12.576601 29772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:12.577283 29772 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [term 1 LEADER]: Becoming Leader. State: Replica: 3c203339938244348f6c6e679902fadb, State: Running, Role: LEADER
I20260809 00:51:12.577819 29772 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c203339938244348f6c6e679902fadb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40705 } }
I20260809 00:51:12.578549 29757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:12.580552 29776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c203339938244348f6c6e679902fadb. Latest consensus state: current_term: 1 leader_uuid: "3c203339938244348f6c6e679902fadb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c203339938244348f6c6e679902fadb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40705 } } }
I20260809 00:51:12.580998 29776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:12.581843 29774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c203339938244348f6c6e679902fadb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c203339938244348f6c6e679902fadb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40705 } } }
I20260809 00:51:12.582258 29774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:12.582762 29782 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:12.588266 29782 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:12.596884 29782 catalog_manager.cc:1347] Generated new cluster ID: 5f0ed7e24ae14aa1b94112b4329e88cc
I20260809 00:51:12.597014 29782 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:12.613873 29782 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:12.615787 29782 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:12.624209 29782 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c203339938244348f6c6e679902fadb: Generated new TSK 0
I20260809 00:51:12.625273 29782 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:12.642254 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29642
W20260809 00:51:12.643383 29750 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:32961
W20260809 00:51:12.644062 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29642: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:12.644235 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29642
2026-08-09T00:51:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2114 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:12 dist-test-slave-t7g5 krb5kdc[29810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:12 dist-test-slave-t7g5 krb5kdc[29810](info): set up 2 sockets
Aug 09 00:51:12 dist-test-slave-t7g5 krb5kdc[29810](info): commencing operation
krb5kdc: starting...
W20260809 00:51:13.885874 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:14 dist-test-slave-t7g5 krb5kdc[29810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:14.190913 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:14.534907 29826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:14.535199 29826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:14.535297 29826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:14.542656 29826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:14.542788 29826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:14.542838 29826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:14.542902 29826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:14.542948 29826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:14.552942 29826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:14.554211 29826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:14.555577 29826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:14.567381 29832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:14.567351 29839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:14.567703 29835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:14.568249 29826 server_base.cc:1034] running on GCE node
I20260809 00:51:14.569015 29826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:14.570385 29826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:14.571591 29826 hybrid_clock.cc:648] HybridClock initialized: now 1786236674571549 us; error 37 us; skew 500 ppm
I20260809 00:51:14.571930 29826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:14 dist-test-slave-t7g5 krb5kdc[29810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236674, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:14.578619 29826 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:14.580171 29826 webserver.cc:460] Webserver started at http://127.0.0.1:40419/ using document root <none> and password file <none>
I20260809 00:51:14.580858 29826 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:14.580984 29826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:14.581283 29826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:14.584385 29826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "dafad2e156d1432980cac4075932e9ab"
format_stamp: "Formatted at 2026-08-09 00:51:14 on dist-test-slave-t7g5"
server_key: "fcdf34bdb6dcb471764421be091dce23"
server_key_iv: "acacfd8f475a3e22497ab70ae96eb9e1"
server_key_version: "encryptionkey@0"
I20260809 00:51:14.585156 29826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "dafad2e156d1432980cac4075932e9ab"
format_stamp: "Formatted at 2026-08-09 00:51:14 on dist-test-slave-t7g5"
server_key: "fcdf34bdb6dcb471764421be091dce23"
server_key_iv: "acacfd8f475a3e22497ab70ae96eb9e1"
server_key_version: "encryptionkey@0"
I20260809 00:51:14.590488 29826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 00:51:14.593935 29851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:14.595249 29826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:51:14.595438 29826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "dafad2e156d1432980cac4075932e9ab"
format_stamp: "Formatted at 2026-08-09 00:51:14 on dist-test-slave-t7g5"
server_key: "fcdf34bdb6dcb471764421be091dce23"
server_key_iv: "acacfd8f475a3e22497ab70ae96eb9e1"
server_key_version: "encryptionkey@0"
I20260809 00:51:14.595641 29826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:14.601491 29826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:14.609460 29826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:14.609781 29826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:14.627980 29826 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36937
I20260809 00:51:14.628021 29930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36937 every 8 connection(s)
I20260809 00:51:14.629451 29826 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:14.633167 29931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:14.639799 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29826
I20260809 00:51:14.639962 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:14.640369 29042 external_mini_cluster.cc:1428] Setting key d6f51e979cf69e5b5c6e0b942337e409
I20260809 00:51:14.643702 29931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab: Bootstrap starting.
I20260809 00:51:14.647269 29931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:14.648029 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:14.642069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59521 (local address 127.0.0.1:36937)
0809 00:51:14.642860 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:14.642872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:14.642912 (+ 40us) server_negotiation.cc:407] Connection header received
0809 00:51:14.644653 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:14.644677 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:14.645001 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:14.645341 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:14.646472 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:14.646479 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:14.646491 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:14.646507 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:14.646570 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:14.646594 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:14.646731 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:14.646894 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 00:51:14.647064 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":351,"threads_started":1}
I20260809 00:51:14.648420 29931 log.cc:824] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:14.651438 29931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab: No bootstrap required, opened a new log
I20260809 00:51:14.651770 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:14.659415 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:14.656982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60449 (local address 127.0.0.1:36937)
0809 00:51:14.657169 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:14.657175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:14.657615 (+ 440us) server_negotiation.cc:407] Connection header received
0809 00:51:14.657795 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:14.657801 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:14.657864 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:14.657974 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:14.658778 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:14.658787 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:14.658791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:14.658811 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:14.658862 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:14.658885 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:14.659013 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:14.659059 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 00:51:14.659117 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:51:14.661213 29931 raft_consensus.cc:348] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dafad2e156d1432980cac4075932e9ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36937 } }
I20260809 00:51:14.661561 29931 raft_consensus.cc:374] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:14.661639 29931 raft_consensus.cc:729] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dafad2e156d1432980cac4075932e9ab, State: Initialized, Role: FOLLOWER
I20260809 00:51:14.662180 29931 consensus_queue.cc:260] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dafad2e156d1432980cac4075932e9ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36937 } }
I20260809 00:51:14.662401 29931 raft_consensus.cc:388] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:14.662503 29931 raft_consensus.cc:482] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:14.662629 29931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:14.664839 29931 raft_consensus.cc:504] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dafad2e156d1432980cac4075932e9ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36937 } }
I20260809 00:51:14.665337 29931 leader_election.cc:302] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dafad2e156d1432980cac4075932e9ab; no voters:
I20260809 00:51:14.665879 29931 leader_election.cc:288] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:14.666010 29945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:14.666641 29945 raft_consensus.cc:686] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [term 1 LEADER]: Becoming Leader. State: Replica: dafad2e156d1432980cac4075932e9ab, State: Running, Role: LEADER
I20260809 00:51:14.667183 29945 consensus_queue.cc:237] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dafad2e156d1432980cac4075932e9ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36937 } }
I20260809 00:51:14.667873 29931 sys_catalog.cc:564] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:14.670398 29946 sys_catalog.cc:455] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dafad2e156d1432980cac4075932e9ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dafad2e156d1432980cac4075932e9ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36937 } } }
I20260809 00:51:14.670905 29946 sys_catalog.cc:458] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:14.670447 29947 sys_catalog.cc:455] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader dafad2e156d1432980cac4075932e9ab. Latest consensus state: current_term: 1 leader_uuid: "dafad2e156d1432980cac4075932e9ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dafad2e156d1432980cac4075932e9ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36937 } } }
I20260809 00:51:14.671062 29947 sys_catalog.cc:458] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:14.672791 29953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:14.678619 29953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:14.688361 29953 catalog_manager.cc:1347] Generated new cluster ID: 377491fafe554b5fb475220dc3f72326
I20260809 00:51:14.688555 29953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:14.709995 29953 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:14.710551 29953 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:14.718813 29953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dafad2e156d1432980cac4075932e9ab: Generated new TSK 0
I20260809 00:51:14.719755 29953 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:14.738286 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29826
W20260809 00:51:14.739574 29923 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59521
W20260809 00:51:14.740224 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29826: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:14.740350 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29826
2026-08-09T00:51:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2096 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:14 dist-test-slave-t7g5 krb5kdc[29975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:14 dist-test-slave-t7g5 krb5kdc[29975](info): set up 2 sockets
Aug 09 00:51:14 dist-test-slave-t7g5 krb5kdc[29975](info): commencing operation
krb5kdc: starting...
W20260809 00:51:15.990886 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:16 dist-test-slave-t7g5 krb5kdc[29975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:16.297880 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41519
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:16.640987 29996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:16.641295 29996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:16.641425 29996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:16.648802 29996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:16.648929 29996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:16.649004 29996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:16.649091 29996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:16.649154 29996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:16.659482 29996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:16.660828 29996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:16.662192 29996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:16.673939 30001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:16.673887 30003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:16.673974 30006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:16.675091 29996 server_base.cc:1034] running on GCE node
I20260809 00:51:16.675930 29996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:16.677336 29996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:16.678576 29996 hybrid_clock.cc:648] HybridClock initialized: now 1786236676678520 us; error 34 us; skew 500 ppm
I20260809 00:51:16.678977 29996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:16 dist-test-slave-t7g5 krb5kdc[29975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236676, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:16.682351 29996 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:16.683797 29996 webserver.cc:460] Webserver started at http://127.0.0.1:37967/ using document root <none> and password file <none>
I20260809 00:51:16.684475 29996 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:16.684599 29996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:16.684954 29996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:16.688019 29996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "dc77b86990604a3db3d0260b50cbabd2"
format_stamp: "Formatted at 2026-08-09 00:51:16 on dist-test-slave-t7g5"
server_key: "c05b6b4b98fff379c303dd7f8b4982c1"
server_key_iv: "63e046e54301c6de3151308071cb68be"
server_key_version: "encryptionkey@0"
I20260809 00:51:16.688782 29996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "dc77b86990604a3db3d0260b50cbabd2"
format_stamp: "Formatted at 2026-08-09 00:51:16 on dist-test-slave-t7g5"
server_key: "c05b6b4b98fff379c303dd7f8b4982c1"
server_key_iv: "63e046e54301c6de3151308071cb68be"
server_key_version: "encryptionkey@0"
I20260809 00:51:16.694042 29996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 00:51:16.697669 30018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:16.699018 29996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:51:16.699198 29996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "dc77b86990604a3db3d0260b50cbabd2"
format_stamp: "Formatted at 2026-08-09 00:51:16 on dist-test-slave-t7g5"
server_key: "c05b6b4b98fff379c303dd7f8b4982c1"
server_key_iv: "63e046e54301c6de3151308071cb68be"
server_key_version: "encryptionkey@0"
I20260809 00:51:16.699389 29996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:16.713241 29996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:16.717518 29996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:16.717818 29996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:16.736227 29996 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41519
I20260809 00:51:16.736261 30098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41519 every 8 connection(s)
I20260809 00:51:16.737622 29996 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:16.741530 30100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:16.746160 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 29996
I20260809 00:51:16.746343 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:16.746778 29042 external_mini_cluster.cc:1428] Setting key ea714161b2d5d953e929f755a163a8eb
I20260809 00:51:16.753073 30100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2: Bootstrap starting.
I20260809 00:51:16.756948 30100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:16.758208 30100 log.cc:824] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:16.761075 30100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2: No bootstrap required, opened a new log
Aug 09 00:51:16 dist-test-slave-t7g5 krb5kdc[29975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 00:51:16.771449 30108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:16.748710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:51759 (local address 127.0.0.1:41519)
0809 00:51:16.749537 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:16.749549 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:16.749595 (+ 46us) server_negotiation.cc:407] Connection header received
0809 00:51:16.751442 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:16.751466 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:16.751881 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:16.752208 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:16.754132 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:16.755504 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:16.757282 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:16.758011 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:16.758141 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:16.762460 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:16.762472 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:16.762492 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:16.762540 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:16.766518 (+ 3978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:16.767406 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:16.767415 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:16.767423 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:16.767647 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:16.768126 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:16.768131 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:16.768134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:16.768853 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:16.769202 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:16.769634 (+ 432us) server_negotiation.cc:299] Negotiation successful
0809 00:51:16.770038 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":360,"threads_started":1}
I20260809 00:51:16.771469 30100 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc77b86990604a3db3d0260b50cbabd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41519 } }
I20260809 00:51:16.771986 30100 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:16.772094 30100 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc77b86990604a3db3d0260b50cbabd2, State: Initialized, Role: FOLLOWER
I20260809 00:51:16.772661 30100 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc77b86990604a3db3d0260b50cbabd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41519 } }
I20260809 00:51:16.772918 30100 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:16.773072 30100 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:16.773283 30100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:16.775717 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:16.776289 30100 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc77b86990604a3db3d0260b50cbabd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41519 } }
I20260809 00:51:16.776844 30100 leader_election.cc:302] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc77b86990604a3db3d0260b50cbabd2; no voters:
I20260809 00:51:16.777483 30100 leader_election.cc:288] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:16.777607 30111 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:16.779743 30100 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:16.781939 30111 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [term 1 LEADER]: Becoming Leader. State: Replica: dc77b86990604a3db3d0260b50cbabd2, State: Running, Role: LEADER
I20260809 00:51:16.782665 30111 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc77b86990604a3db3d0260b50cbabd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41519 } }
I20260809 00:51:16.785179 30113 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc77b86990604a3db3d0260b50cbabd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc77b86990604a3db3d0260b50cbabd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41519 } } }
I20260809 00:51:16.785646 30115 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc77b86990604a3db3d0260b50cbabd2. Latest consensus state: current_term: 1 leader_uuid: "dc77b86990604a3db3d0260b50cbabd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc77b86990604a3db3d0260b50cbabd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41519 } } }
I20260809 00:51:16.785955 30115 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:16.785646 30113 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2 [sys.catalog]: This master's current role is: LEADER
W20260809 00:51:16.793325 30139 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:51:16.793526 30139 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:51:16.795789 30131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:16.798143 30131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:16.803965 30108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:16.786768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:40889 (local address 127.0.0.1:41519)
0809 00:51:16.786959 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:16.786965 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:16.788883 (+ 1918us) server_negotiation.cc:407] Connection header received
0809 00:51:16.789106 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:16.789112 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:16.789208 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:16.789325 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:16.791548 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:16.792732 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:16.794340 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:16.794982 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:16.795095 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:16.797630 (+ 2535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:16.797635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:16.797638 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:16.797698 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:16.800576 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:16.801403 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:16.801409 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:16.801412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:16.801549 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:16.802057 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:16.802064 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:16.802067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:16.802518 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:16.802804 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:16.803412 (+ 608us) server_negotiation.cc:299] Negotiation successful
0809 00:51:16.803609 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:51:16.808557 30131 catalog_manager.cc:1347] Generated new cluster ID: e3db6b79ee384c14b030755e889648be
I20260809 00:51:16.808689 30131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:16.871925 30131 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:16.873730 30131 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:16.880088 30131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc77b86990604a3db3d0260b50cbabd2: Generated new TSK 0
I20260809 00:51:16.880852 30131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:16.897324 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 29996
I20260809 00:51:16.898964 30093 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:16.993366 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 29996
W20260809 00:51:17.019125 29971 connection.cc:535] client connection to 127.0.0.1:41519 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41519): Connection reset by peer (error 104)
2026-08-09T00:51:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2250 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:17 dist-test-slave-t7g5 krb5kdc[30149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:17 dist-test-slave-t7g5 krb5kdc[30149](info): set up 2 sockets
Aug 09 00:51:17 dist-test-slave-t7g5 krb5kdc[30149](info): commencing operation
krb5kdc: starting...
W20260809 00:51:18.224828 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.187s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:18 dist-test-slave-t7g5 krb5kdc[30149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:18.532868 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39113
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:18.875015 30170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:18.875322 30170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:18.875429 30170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:18.882727 30170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:18.882839 30170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:18.882892 30170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:18.882954 30170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:18.882998 30170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:18.892838 30170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:18.894083 30170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:18.895367 30170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:18.906503 30182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:18.906555 30177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:18.906579 30179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:18.907552 30170 server_base.cc:1034] running on GCE node
I20260809 00:51:18.908306 30170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:18.909626 30170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:18.910867 30170 hybrid_clock.cc:648] HybridClock initialized: now 1786236678910823 us; error 30 us; skew 500 ppm
I20260809 00:51:18.911206 30170 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:18 dist-test-slave-t7g5 krb5kdc[30149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236678, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:18.914309 30170 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:18.915735 30170 webserver.cc:460] Webserver started at http://127.0.0.1:33397/ using document root <none> and password file <none>
I20260809 00:51:18.916395 30170 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:18.916519 30170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:18.916810 30170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:18.919780 30170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "e7839bf417dd410eb05e94db122d5e31"
format_stamp: "Formatted at 2026-08-09 00:51:18 on dist-test-slave-t7g5"
server_key: "67fc980933c7c78d67be8a6bd873e28f"
server_key_iv: "844ed99814e21cfcb019e8cd8208807d"
server_key_version: "encryptionkey@0"
I20260809 00:51:18.920536 30170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "e7839bf417dd410eb05e94db122d5e31"
format_stamp: "Formatted at 2026-08-09 00:51:18 on dist-test-slave-t7g5"
server_key: "67fc980933c7c78d67be8a6bd873e28f"
server_key_iv: "844ed99814e21cfcb019e8cd8208807d"
server_key_version: "encryptionkey@0"
I20260809 00:51:18.925447 30170 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:51:18.928793 30190 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:18.930101 30170 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:18.930256 30170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "e7839bf417dd410eb05e94db122d5e31"
format_stamp: "Formatted at 2026-08-09 00:51:18 on dist-test-slave-t7g5"
server_key: "67fc980933c7c78d67be8a6bd873e28f"
server_key_iv: "844ed99814e21cfcb019e8cd8208807d"
server_key_version: "encryptionkey@0"
I20260809 00:51:18.930440 30170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:18.943338 30170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:18.947108 30170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:18.947378 30170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:18.965086 30170 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39113
I20260809 00:51:18.965130 30274 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39113 every 8 connection(s)
I20260809 00:51:18.966471 30170 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:18.970114 30275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:18.973976 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30170
I20260809 00:51:18.974159 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:18.974702 29042 external_mini_cluster.cc:1428] Setting key 4dd6b22319ededa74d94a041f259c8a5
I20260809 00:51:18.982759 30275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31: Bootstrap starting.
I20260809 00:51:18.986305 30275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:18.987430 30275 log.cc:824] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:18.987756 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:18.976495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:47609 (local address 127.0.0.1:39113)
0809 00:51:18.977213 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:18.977225 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:18.977266 (+ 41us) server_negotiation.cc:407] Connection header received
0809 00:51:18.978929 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:18.978952 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:18.979377 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:18.979695 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:18.980287 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:18.981616 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:18.983438 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:18.984067 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:18.984204 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:18.985455 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:18.985463 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:18.985475 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:18.986015 (+ 540us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:18.986096 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:18.986120 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:18.986240 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:18.986577 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 00:51:18.986761 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":317,"threads_started":1}
I20260809 00:51:18.990173 30275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31: No bootstrap required, opened a new log
I20260809 00:51:18.991341 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:18.999971 30275 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7839bf417dd410eb05e94db122d5e31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39113 } }
I20260809 00:51:19.000377 30275 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:19.000495 30275 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7839bf417dd410eb05e94db122d5e31, State: Initialized, Role: FOLLOWER
I20260809 00:51:19.001188 30275 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7839bf417dd410eb05e94db122d5e31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39113 } }
I20260809 00:51:19.001449 30275 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:19.001590 30275 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:19.001767 30275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:19.002939 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:18.996484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:44471 (local address 127.0.0.1:39113)
0809 00:51:18.996672 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:18.996677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:18.997077 (+ 400us) server_negotiation.cc:407] Connection header received
0809 00:51:18.997216 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:18.997222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:18.997300 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:18.997399 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:18.997898 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:18.999061 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:19.000327 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:19.000954 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:19.001074 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:19.002183 (+ 1109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:19.002188 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:19.002191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:19.002207 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:19.002246 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:19.002261 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:19.002355 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:19.002561 (+ 206us) server_negotiation.cc:299] Negotiation successful
0809 00:51:19.002608 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:51:19.004691 30275 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7839bf417dd410eb05e94db122d5e31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39113 } }
I20260809 00:51:19.005198 30275 leader_election.cc:302] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7839bf417dd410eb05e94db122d5e31; no voters:
I20260809 00:51:19.005810 30275 leader_election.cc:288] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:19.005944 30290 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:19.006528 30290 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [term 1 LEADER]: Becoming Leader. State: Replica: e7839bf417dd410eb05e94db122d5e31, State: Running, Role: LEADER
I20260809 00:51:19.007200 30290 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7839bf417dd410eb05e94db122d5e31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39113 } }
I20260809 00:51:19.009418 30290 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7839bf417dd410eb05e94db122d5e31. Latest consensus state: current_term: 1 leader_uuid: "e7839bf417dd410eb05e94db122d5e31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7839bf417dd410eb05e94db122d5e31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39113 } } }
I20260809 00:51:19.009770 30290 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:19.010013 30293 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7839bf417dd410eb05e94db122d5e31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7839bf417dd410eb05e94db122d5e31" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39113 } } }
I20260809 00:51:19.010409 30293 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:19.010987 30275 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:19.014487 30298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:19.019559 30298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:19.029000 30298 catalog_manager.cc:1347] Generated new cluster ID: d48f1b7272c94c0fb4c0bb131a77b99a
I20260809 00:51:19.029124 30298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:19.046775 30298 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:19.048122 30298 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:19.056919 30298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7839bf417dd410eb05e94db122d5e31: Generated new TSK 0
I20260809 00:51:19.057777 30298 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:19.066679 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30170
W20260809 00:51:19.067811 30270 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.70:47609
W20260809 00:51:19.068499 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30170: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:19.068626 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30170
W20260809 00:51:19.095806 30146 connection.cc:535] client connection to 127.0.0.1:39113 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39113): Connection reset by peer (error 104)
2026-08-09T00:51:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2076 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:19 dist-test-slave-t7g5 krb5kdc[30326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:19 dist-test-slave-t7g5 krb5kdc[30326](info): set up 2 sockets
Aug 09 00:51:19 dist-test-slave-t7g5 krb5kdc[30326](info): commencing operation
krb5kdc: starting...
W20260809 00:51:20.309041 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:20 dist-test-slave-t7g5 krb5kdc[30326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:20.623306 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45679
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:20.966078 30345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:20.966377 30345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:20.966470 30345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:20.973811 30345 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:20.973932 30345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:20.973990 30345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:20.974052 30345 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:20.974097 30345 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:20.984418 30345 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:20.985733 30345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:20.987047 30345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:20.998498 30353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:20.998521 30357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:20.998476 30355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:20.999269 30345 server_base.cc:1034] running on GCE node
I20260809 00:51:21.000052 30345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:21.001420 30345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:21.002630 30345 hybrid_clock.cc:648] HybridClock initialized: now 1786236681002565 us; error 59 us; skew 500 ppm
I20260809 00:51:21.002974 30345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:21 dist-test-slave-t7g5 krb5kdc[30326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236681, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:21.009366 30345 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:21.010946 30345 webserver.cc:460] Webserver started at http://127.0.0.1:33239/ using document root <none> and password file <none>
I20260809 00:51:21.011649 30345 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:21.011776 30345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:21.012089 30345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:21.015237 30345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "1f95824575ff4ff1ada10f3c277d26f0"
format_stamp: "Formatted at 2026-08-09 00:51:21 on dist-test-slave-t7g5"
server_key: "def042147161821159fb3b5afe29df22"
server_key_iv: "e58c33b4e89c3fbb52690c6730094b98"
server_key_version: "encryptionkey@0"
I20260809 00:51:21.016062 30345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "1f95824575ff4ff1ada10f3c277d26f0"
format_stamp: "Formatted at 2026-08-09 00:51:21 on dist-test-slave-t7g5"
server_key: "def042147161821159fb3b5afe29df22"
server_key_iv: "e58c33b4e89c3fbb52690c6730094b98"
server_key_version: "encryptionkey@0"
I20260809 00:51:21.021457 30345 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:51:21.025024 30367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:21.026438 30345 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:21.026608 30345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "1f95824575ff4ff1ada10f3c277d26f0"
format_stamp: "Formatted at 2026-08-09 00:51:21 on dist-test-slave-t7g5"
server_key: "def042147161821159fb3b5afe29df22"
server_key_iv: "e58c33b4e89c3fbb52690c6730094b98"
server_key_version: "encryptionkey@0"
I20260809 00:51:21.026803 30345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:21.032745 30345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:21.037104 30345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:21.037405 30345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:21.055424 30345 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45679
I20260809 00:51:21.055487 30445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45679 every 8 connection(s)
I20260809 00:51:21.056854 30345 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:21.060621 30446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:21.065261 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30345
I20260809 00:51:21.065433 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:21.065935 29042 external_mini_cluster.cc:1428] Setting key f4da683e5b4ba83b73d11170d403f508
I20260809 00:51:21.071873 30446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0: Bootstrap starting.
I20260809 00:51:21.073689 30451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:21.067685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:34207 (local address 127.0.0.1:45679)
0809 00:51:21.068581 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:21.068596 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:21.068642 (+ 46us) server_negotiation.cc:407] Connection header received
0809 00:51:21.070444 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:21.070470 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:21.070788 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:21.071099 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:21.072158 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:21.072165 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:21.072177 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:21.072198 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:21.072258 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:21.072278 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:21.072450 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:21.072555 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 00:51:21.072721 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":363,"threads_started":1}
I20260809 00:51:21.075399 30446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:21.076628 30446 log.cc:824] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:21.077316 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:21.079612 30446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0: No bootstrap required, opened a new log
I20260809 00:51:21.084641 30451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:21.082341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:36133 (local address 127.0.0.1:45679)
0809 00:51:21.082527 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:21.082534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:21.082914 (+ 380us) server_negotiation.cc:407] Connection header received
0809 00:51:21.083049 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:21.083055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:21.083113 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:21.083223 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:21.084001 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:21.084007 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:21.084012 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:21.084030 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:21.084078 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:21.084098 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:21.084222 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:21.084279 (+ 57us) server_negotiation.cc:299] Negotiation successful
0809 00:51:21.084345 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 00:51:21.088213 30446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f95824575ff4ff1ada10f3c277d26f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45679 } }
I20260809 00:51:21.088572 30446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:21.088651 30446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f95824575ff4ff1ada10f3c277d26f0, State: Initialized, Role: FOLLOWER
I20260809 00:51:21.089181 30446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f95824575ff4ff1ada10f3c277d26f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45679 } }
I20260809 00:51:21.089455 30446 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:21.089583 30446 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:21.089781 30446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:21.092001 30446 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f95824575ff4ff1ada10f3c277d26f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45679 } }
I20260809 00:51:21.092504 30446 leader_election.cc:302] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f95824575ff4ff1ada10f3c277d26f0; no voters:
I20260809 00:51:21.093078 30446 leader_election.cc:288] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:21.093202 30462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:21.093854 30462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1f95824575ff4ff1ada10f3c277d26f0, State: Running, Role: LEADER
I20260809 00:51:21.094415 30462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f95824575ff4ff1ada10f3c277d26f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45679 } }
I20260809 00:51:21.095132 30446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:21.096863 30465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f95824575ff4ff1ada10f3c277d26f0. Latest consensus state: current_term: 1 leader_uuid: "1f95824575ff4ff1ada10f3c277d26f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f95824575ff4ff1ada10f3c277d26f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45679 } } }
I20260809 00:51:21.097262 30465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:21.097844 30464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f95824575ff4ff1ada10f3c277d26f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f95824575ff4ff1ada10f3c277d26f0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45679 } } }
I20260809 00:51:21.098212 30464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:21.098922 30468 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:21.104512 30468 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:21.112777 30468 catalog_manager.cc:1347] Generated new cluster ID: 6b35b9445f574d80af9e19602874ad29
I20260809 00:51:21.112896 30468 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:21.151153 30468 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:21.151608 30468 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:21.161237 30468 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f95824575ff4ff1ada10f3c277d26f0: Generated new TSK 0
I20260809 00:51:21.162129 30468 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:21.166893 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30345
W20260809 00:51:21.168018 30441 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.70:34207
W20260809 00:51:21.168815 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30345: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:21.168958 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30345
2026-08-09T00:51:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2100 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:21 dist-test-slave-t7g5 krb5kdc[30495](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:21 dist-test-slave-t7g5 krb5kdc[30495](info): set up 2 sockets
Aug 09 00:51:21 dist-test-slave-t7g5 krb5kdc[30495](info): commencing operation
krb5kdc: starting...
W20260809 00:51:22.404788 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.004s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:22 dist-test-slave-t7g5 krb5kdc[30495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:22.717041 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42963
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:23.058197 30517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:23.058521 30517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:23.058666 30517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:23.066032 30517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:23.066166 30517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:23.066249 30517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:23.066342 30517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:23.066406 30517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:23.076766 30517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42963
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:23.078477 30517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:23.079826 30517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:23.091578 30526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:23.091619 30527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:23.091641 30534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:23.092440 30517 server_base.cc:1034] running on GCE node
I20260809 00:51:23.093329 30517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:23.094841 30517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:23.096050 30517 hybrid_clock.cc:648] HybridClock initialized: now 1786236683095997 us; error 45 us; skew 500 ppm
I20260809 00:51:23.096407 30517 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:23 dist-test-slave-t7g5 krb5kdc[30495](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236683, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:23.099566 30517 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:23.101094 30517 webserver.cc:460] Webserver started at http://127.0.0.1:34923/ using document root <none> and password file <none>
I20260809 00:51:23.101817 30517 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:23.101936 30517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:23.102200 30517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:23.105202 30517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "61aa0efa066548d1be42b254bd60876e"
format_stamp: "Formatted at 2026-08-09 00:51:23 on dist-test-slave-t7g5"
server_key: "ff4b5bab105b5dd1c5d1535f57f44ea5"
server_key_iv: "97abf028a36bf034b95b98984782da8e"
server_key_version: "encryptionkey@0"
I20260809 00:51:23.105995 30517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "61aa0efa066548d1be42b254bd60876e"
format_stamp: "Formatted at 2026-08-09 00:51:23 on dist-test-slave-t7g5"
server_key: "ff4b5bab105b5dd1c5d1535f57f44ea5"
server_key_iv: "97abf028a36bf034b95b98984782da8e"
server_key_version: "encryptionkey@0"
I20260809 00:51:23.111191 30517 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 00:51:23.114809 30545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:23.116112 30517 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:51:23.116263 30517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "61aa0efa066548d1be42b254bd60876e"
format_stamp: "Formatted at 2026-08-09 00:51:23 on dist-test-slave-t7g5"
server_key: "ff4b5bab105b5dd1c5d1535f57f44ea5"
server_key_iv: "97abf028a36bf034b95b98984782da8e"
server_key_version: "encryptionkey@0"
I20260809 00:51:23.116436 30517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:23.146287 30517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:23.150835 30517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:23.151134 30517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:23.169437 30517 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42963
I20260809 00:51:23.169482 30620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42963 every 8 connection(s)
I20260809 00:51:23.170930 30517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:23.174935 30623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:23.178090 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30517
I20260809 00:51:23.178277 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:23.178833 29042 external_mini_cluster.cc:1428] Setting key d56171813a7177fbeffb79757dde648f
I20260809 00:51:23.187175 30623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e: Bootstrap starting.
I20260809 00:51:23.190475 30623 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:23.191473 30623 log.cc:824] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e: Log is configured to *not* fsync() on all Append() calls
Aug 09 00:51:23 dist-test-slave-t7g5 krb5kdc[30495](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 00:51:23.194394 30623 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e: No bootstrap required, opened a new log
I20260809 00:51:23.200949 30628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:23.180785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:38017 (local address 127.0.0.1:42963)
0809 00:51:23.181587 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:23.181599 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:23.181643 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:51:23.183375 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:23.183399 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:23.183807 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:23.184176 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:23.185747 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:23.187062 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:23.188319 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:23.189100 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:23.189275 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:23.193407 (+ 4132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:23.193416 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:23.193440 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:23.193475 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:23.196563 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:23.197346 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:23.197353 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:23.197359 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:23.197553 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:23.198061 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:23.198065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:23.198067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:23.198635 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:23.198958 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:23.199521 (+ 563us) server_negotiation.cc:299] Negotiation successful
0809 00:51:23.199852 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":334,"threads_started":1}
I20260809 00:51:23.202579 30623 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61aa0efa066548d1be42b254bd60876e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42963 } }
I20260809 00:51:23.203048 30623 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:23.203166 30623 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61aa0efa066548d1be42b254bd60876e, State: Initialized, Role: FOLLOWER
I20260809 00:51:23.203748 30623 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61aa0efa066548d1be42b254bd60876e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42963 } }
I20260809 00:51:23.204041 30623 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:23.204201 30623 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:23.204365 30623 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:23.205118 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:23.206743 30623 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61aa0efa066548d1be42b254bd60876e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42963 } }
I20260809 00:51:23.207211 30623 leader_election.cc:302] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61aa0efa066548d1be42b254bd60876e; no voters:
I20260809 00:51:23.207882 30623 leader_election.cc:288] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:23.208029 30633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:23.209424 30633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [term 1 LEADER]: Becoming Leader. State: Replica: 61aa0efa066548d1be42b254bd60876e, State: Running, Role: LEADER
I20260809 00:51:23.210044 30633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61aa0efa066548d1be42b254bd60876e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42963 } }
I20260809 00:51:23.210270 30623 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:23.212837 30641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61aa0efa066548d1be42b254bd60876e. Latest consensus state: current_term: 1 leader_uuid: "61aa0efa066548d1be42b254bd60876e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61aa0efa066548d1be42b254bd60876e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42963 } } }
I20260809 00:51:23.213248 30641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:23.213958 30638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61aa0efa066548d1be42b254bd60876e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61aa0efa066548d1be42b254bd60876e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42963 } } }
I20260809 00:51:23.214286 30638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:23.222684 30658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:23.228579 30658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:23.235005 30628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:23.211026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:51983 (local address 127.0.0.1:42963)
0809 00:51:23.211219 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:23.211225 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:23.218134 (+ 6909us) server_negotiation.cc:407] Connection header received
0809 00:51:23.218308 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:23.218312 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:23.218378 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:23.218481 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:23.220175 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:23.221065 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:23.222724 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:23.223391 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:23.223513 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:23.227073 (+ 3560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:23.227080 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:23.227085 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:23.227136 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:23.231023 (+ 3887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:23.232056 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:23.232062 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:23.232065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:23.232223 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:23.232770 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:23.232776 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:23.232779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:23.233228 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:23.233502 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:23.234436 (+ 934us) server_negotiation.cc:299] Negotiation successful
0809 00:51:23.234629 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:51:23.238221 30658 catalog_manager.cc:1347] Generated new cluster ID: fe2682453fc845b79fdd28a170e152b6
I20260809 00:51:23.238328 30658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:23.250379 30658 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:23.251631 30658 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:23.259276 30658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61aa0efa066548d1be42b254bd60876e: Generated new TSK 0
I20260809 00:51:23.260036 30658 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:23.266459 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30517
I20260809 00:51:23.268045 30611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:23.357280 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30517
W20260809 00:51:23.380375 30491 connection.cc:535] client connection to 127.0.0.1:42963 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42963): Connection reset by peer (error 104)
2026-08-09T00:51:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2184 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:23 dist-test-slave-t7g5 krb5kdc[30681](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:23 dist-test-slave-t7g5 krb5kdc[30681](info): set up 2 sockets
Aug 09 00:51:23 dist-test-slave-t7g5 krb5kdc[30681](info): commencing operation
krb5kdc: starting...
W20260809 00:51:24.590094 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.191s user 0.006s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:24 dist-test-slave-t7g5 krb5kdc[30681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:24.913249 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35507
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:25.280290 30702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:25.280613 30702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:25.280761 30702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:25.288051 30702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:25.288177 30702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:25.288266 30702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:25.288348 30702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:25.288405 30702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:25.298311 30702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35507
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:25.299644 30702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:25.300956 30702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:25.312441 30716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:25.312489 30714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:25.312719 30713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:25.313478 30702 server_base.cc:1034] running on GCE node
I20260809 00:51:25.314299 30702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:25.315677 30702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:25.316897 30702 hybrid_clock.cc:648] HybridClock initialized: now 1786236685316853 us; error 51 us; skew 500 ppm
I20260809 00:51:25.317245 30702 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:25 dist-test-slave-t7g5 krb5kdc[30681](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236685, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:25.320319 30702 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:25.321708 30702 webserver.cc:460] Webserver started at http://127.0.0.1:38707/ using document root <none> and password file <none>
I20260809 00:51:25.322347 30702 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:25.322453 30702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:25.322744 30702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:25.325698 30702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "a165afe229b94557a6df52b46585edc5"
format_stamp: "Formatted at 2026-08-09 00:51:25 on dist-test-slave-t7g5"
server_key: "7b382a7c84d2d7552b3956c8989df692"
server_key_iv: "cc2f256d709b47ce14e79a7328348781"
server_key_version: "encryptionkey@0"
I20260809 00:51:25.326424 30702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "a165afe229b94557a6df52b46585edc5"
format_stamp: "Formatted at 2026-08-09 00:51:25 on dist-test-slave-t7g5"
server_key: "7b382a7c84d2d7552b3956c8989df692"
server_key_iv: "cc2f256d709b47ce14e79a7328348781"
server_key_version: "encryptionkey@0"
I20260809 00:51:25.331303 30702 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260809 00:51:25.335116 30730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:25.336604 30702 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 00:51:25.336773 30702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "a165afe229b94557a6df52b46585edc5"
format_stamp: "Formatted at 2026-08-09 00:51:25 on dist-test-slave-t7g5"
server_key: "7b382a7c84d2d7552b3956c8989df692"
server_key_iv: "cc2f256d709b47ce14e79a7328348781"
server_key_version: "encryptionkey@0"
I20260809 00:51:25.336997 30702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:25.349996 30702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:25.354010 30702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:25.354270 30702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:25.371296 30702 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35507
I20260809 00:51:25.371336 30816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35507 every 8 connection(s)
I20260809 00:51:25.372666 30702 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:25.373854 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30702
I20260809 00:51:25.374044 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:25.374598 29042 external_mini_cluster.cc:1428] Setting key 51120056aef8fd7f01137ce2b2b7dcb8
I20260809 00:51:25.377323 30817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:25.389391 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:25.376386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:46987 (local address 127.0.0.1:35507)
0809 00:51:25.377187 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:25.377202 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:25.377253 (+ 51us) server_negotiation.cc:407] Connection header received
0809 00:51:25.379549 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:25.379577 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:25.380056 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:25.380506 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:25.381008 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:25.383019 (+ 2011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:25.384316 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:25.385358 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:25.385543 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:25.386653 (+ 1110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:25.386665 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:25.386684 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:25.387418 (+ 734us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:25.387511 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:25.387541 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:25.387721 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:25.387885 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 00:51:25.388064 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":315,"threads_started":1}
I20260809 00:51:25.391080 30817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5: Bootstrap starting.
I20260809 00:51:25.393148 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:25.394498 30817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:25.395756 30817 log.cc:824] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:25.399433 30817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5: No bootstrap required, opened a new log
I20260809 00:51:25.405948 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:25.399191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:53097 (local address 127.0.0.1:35507)
0809 00:51:25.399381 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:25.399387 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:25.399794 (+ 407us) server_negotiation.cc:407] Connection header received
0809 00:51:25.399972 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:25.399978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:25.400060 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:25.400176 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:25.400627 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:25.401801 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:25.403106 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:25.403788 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:25.403911 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:25.405116 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:25.405123 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:25.405131 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:25.405151 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:25.405210 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:25.405234 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:25.405352 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:25.405523 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 00:51:25.405575 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:51:25.408304 30817 raft_consensus.cc:348] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a165afe229b94557a6df52b46585edc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35507 } }
I20260809 00:51:25.408658 30817 raft_consensus.cc:374] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:25.408759 30817 raft_consensus.cc:729] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a165afe229b94557a6df52b46585edc5, State: Initialized, Role: FOLLOWER
I20260809 00:51:25.409372 30817 consensus_queue.cc:260] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a165afe229b94557a6df52b46585edc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35507 } }
I20260809 00:51:25.409626 30817 raft_consensus.cc:388] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:25.409799 30817 raft_consensus.cc:482] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:25.409966 30817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:25.412088 30817 raft_consensus.cc:504] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a165afe229b94557a6df52b46585edc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35507 } }
I20260809 00:51:25.412567 30817 leader_election.cc:302] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a165afe229b94557a6df52b46585edc5; no voters:
I20260809 00:51:25.413164 30817 leader_election.cc:288] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:25.413311 30834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:25.414067 30834 raft_consensus.cc:686] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [term 1 LEADER]: Becoming Leader. State: Replica: a165afe229b94557a6df52b46585edc5, State: Running, Role: LEADER
I20260809 00:51:25.415346 30834 consensus_queue.cc:237] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a165afe229b94557a6df52b46585edc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35507 } }
I20260809 00:51:25.415493 30817 sys_catalog.cc:564] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:25.418270 30836 sys_catalog.cc:455] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a165afe229b94557a6df52b46585edc5. Latest consensus state: current_term: 1 leader_uuid: "a165afe229b94557a6df52b46585edc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a165afe229b94557a6df52b46585edc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35507 } } }
I20260809 00:51:25.418771 30836 sys_catalog.cc:458] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:25.418277 30835 sys_catalog.cc:455] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a165afe229b94557a6df52b46585edc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a165afe229b94557a6df52b46585edc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35507 } } }
I20260809 00:51:25.419180 30835 sys_catalog.cc:458] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:25.420260 30840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:25.425514 30840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:25.436033 30840 catalog_manager.cc:1347] Generated new cluster ID: 056ac05dcf1d4d1782949746bd293e77
I20260809 00:51:25.436169 30840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:25.448855 30840 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:25.450145 30840 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:25.459671 30840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a165afe229b94557a6df52b46585edc5: Generated new TSK 0
I20260809 00:51:25.460800 30840 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:25.467487 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30702
W20260809 00:51:25.469266 30810 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.70:46987
W20260809 00:51:25.470089 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30702: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:25.470266 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30702
W20260809 00:51:25.498951 30678 connection.cc:535] client connection to 127.0.0.1:35507 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35507): Connection reset by peer (error 104)
2026-08-09T00:51:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2119 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:25 dist-test-slave-t7g5 krb5kdc[30861](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:25 dist-test-slave-t7g5 krb5kdc[30861](info): set up 2 sockets
Aug 09 00:51:25 dist-test-slave-t7g5 krb5kdc[30861](info): commencing operation
krb5kdc: starting...
W20260809 00:51:26.715281 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.196s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:26 dist-test-slave-t7g5 krb5kdc[30861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236686, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 00:51:27.030784 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42185
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:27.377219 30876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:27.377511 30876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:27.377671 30876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:27.384908 30876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:27.385016 30876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:27.385090 30876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:27.385185 30876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:27.385244 30876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:27.395533 30876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42185
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:27.396936 30876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:27.398348 30876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:27.409942 30884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:27.409938 30885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:27.409938 30888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:27.411129 30876 server_base.cc:1034] running on GCE node
I20260809 00:51:27.411943 30876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:27.413329 30876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:27.414572 30876 hybrid_clock.cc:648] HybridClock initialized: now 1786236687414508 us; error 49 us; skew 500 ppm
I20260809 00:51:27.414948 30876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:27 dist-test-slave-t7g5 krb5kdc[30861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236687, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:27.420964 30876 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 00:51:27.422436 30876 webserver.cc:460] Webserver started at http://127.0.0.1:46177/ using document root <none> and password file <none>
I20260809 00:51:27.423115 30876 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:27.423233 30876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:27.423537 30876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:27.426617 30876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "86dbbdcf312649309f49165600b07530"
format_stamp: "Formatted at 2026-08-09 00:51:27 on dist-test-slave-t7g5"
server_key: "ce4283464ba8d6986411b78dfd9a16b6"
server_key_iv: "4412d8b2a680d891f938f4d8c1eccc0a"
server_key_version: "encryptionkey@0"
I20260809 00:51:27.427393 30876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "86dbbdcf312649309f49165600b07530"
format_stamp: "Formatted at 2026-08-09 00:51:27 on dist-test-slave-t7g5"
server_key: "ce4283464ba8d6986411b78dfd9a16b6"
server_key_iv: "4412d8b2a680d891f938f4d8c1eccc0a"
server_key_version: "encryptionkey@0"
I20260809 00:51:27.432761 30876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:51:27.436496 30902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:27.437937 30876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:27.438113 30876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "86dbbdcf312649309f49165600b07530"
format_stamp: "Formatted at 2026-08-09 00:51:27 on dist-test-slave-t7g5"
server_key: "ce4283464ba8d6986411b78dfd9a16b6"
server_key_iv: "4412d8b2a680d891f938f4d8c1eccc0a"
server_key_version: "encryptionkey@0"
I20260809 00:51:27.438311 30876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:27.444156 30876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:27.448307 30876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:27.448588 30876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:27.467484 30876 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42185
I20260809 00:51:27.467535 30992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42185 every 8 connection(s)
I20260809 00:51:27.469019 30876 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:27.471719 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 30876
I20260809 00:51:27.471922 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:27.472471 29042 external_mini_cluster.cc:1428] Setting key e468a96c6182fcb24e3b9da7d7b03c9c
I20260809 00:51:27.473572 30994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:27.480469 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:27.474394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:49347 (local address 127.0.0.1:42185)
0809 00:51:27.475214 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:27.475226 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:27.475270 (+ 44us) server_negotiation.cc:407] Connection header received
0809 00:51:27.476939 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:27.476964 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:27.477339 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:27.477737 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:27.478801 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:27.478808 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:27.478824 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:27.478846 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:27.478927 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:27.478951 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:27.479145 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:27.479250 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 00:51:27.479451 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":353,"threads_started":1}
I20260809 00:51:27.484263 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:27.487552 30994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530: Bootstrap starting.
I20260809 00:51:27.491659 30994 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:27.492024 30999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:27.489638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:38957 (local address 127.0.0.1:42185)
0809 00:51:27.489875 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:27.489881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:27.490179 (+ 298us) server_negotiation.cc:407] Connection header received
0809 00:51:27.490386 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:27.490390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:27.490439 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:27.490519 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:27.491389 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:27.491392 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:27.491395 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:27.491407 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:27.491436 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:27.491449 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:27.491533 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:27.491673 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 00:51:27.491721 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260809 00:51:27.492861 30994 log.cc:824] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:27.495595 30994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530: No bootstrap required, opened a new log
I20260809 00:51:27.503312 30994 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86dbbdcf312649309f49165600b07530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42185 } }
I20260809 00:51:27.503762 30994 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:27.503860 30994 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86dbbdcf312649309f49165600b07530, State: Initialized, Role: FOLLOWER
I20260809 00:51:27.504491 30994 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86dbbdcf312649309f49165600b07530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42185 } }
I20260809 00:51:27.504731 30994 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:27.504856 30994 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:27.505010 30994 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:27.507547 30994 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86dbbdcf312649309f49165600b07530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42185 } }
I20260809 00:51:27.508183 30994 leader_election.cc:302] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86dbbdcf312649309f49165600b07530; no voters:
I20260809 00:51:27.508786 30994 leader_election.cc:288] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:27.508921 31010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:27.509526 31010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [term 1 LEADER]: Becoming Leader. State: Replica: 86dbbdcf312649309f49165600b07530, State: Running, Role: LEADER
I20260809 00:51:27.510190 31010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86dbbdcf312649309f49165600b07530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42185 } }
I20260809 00:51:27.511042 30994 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:27.512995 31011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86dbbdcf312649309f49165600b07530. Latest consensus state: current_term: 1 leader_uuid: "86dbbdcf312649309f49165600b07530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86dbbdcf312649309f49165600b07530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42185 } } }
I20260809 00:51:27.513005 31013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86dbbdcf312649309f49165600b07530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86dbbdcf312649309f49165600b07530" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42185 } } }
I20260809 00:51:27.513484 31011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:27.513612 31013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:27.514945 31018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:27.521426 31018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:27.530646 31018 catalog_manager.cc:1347] Generated new cluster ID: 12a5b2f9748740e984bf40163878fa4d
I20260809 00:51:27.530771 31018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:27.584384 31018 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:27.584903 31018 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:27.598335 31018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86dbbdcf312649309f49165600b07530: Generated new TSK 0
I20260809 00:51:27.599385 31018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:27.605297 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30876
W20260809 00:51:27.606429 30979 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.70:49347
W20260809 00:51:27.607082 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 30876: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:27.607234 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 30876
2026-08-09T00:51:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2131 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:27 dist-test-slave-t7g5 krb5kdc[31043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:27 dist-test-slave-t7g5 krb5kdc[31043](info): set up 2 sockets
Aug 09 00:51:27 dist-test-slave-t7g5 krb5kdc[31043](info): commencing operation
krb5kdc: starting...
W20260809 00:51:28.834407 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:29 dist-test-slave-t7g5 krb5kdc[31043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:29.147094 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33969
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:33969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:29.492638 31063 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:29.492956 31063 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:29.493098 31063 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:29.500451 31063 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:29.500579 31063 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:29.500661 31063 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:29.500743 31063 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:29.500805 31063 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:29.511057 31063 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:33969
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:29.512437 31063 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:29.513782 31063 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:29.525063 31073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:29.525097 31077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:29.524998 31069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:29.526091 31063 server_base.cc:1034] running on GCE node
I20260809 00:51:29.526881 31063 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:29.528252 31063 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:29.529460 31063 hybrid_clock.cc:648] HybridClock initialized: now 1786236689529420 us; error 25 us; skew 500 ppm
I20260809 00:51:29.529848 31063 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:29 dist-test-slave-t7g5 krb5kdc[31043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236689, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:29.532866 31063 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:29.534386 31063 webserver.cc:460] Webserver started at http://127.28.92.190:45677/ using document root <none> and password file <none>
I20260809 00:51:29.535063 31063 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:29.535185 31063 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:29.535488 31063 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:29.538542 31063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "64a1cd541e8040aabaf927fdd0bf7f38"
format_stamp: "Formatted at 2026-08-09 00:51:29 on dist-test-slave-t7g5"
server_key: "09d5c9c9f36b62462c28eb68fea097ce"
server_key_iv: "83c2d97191902ccfb03f021e4d961788"
server_key_version: "encryptionkey@0"
I20260809 00:51:29.539315 31063 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "64a1cd541e8040aabaf927fdd0bf7f38"
format_stamp: "Formatted at 2026-08-09 00:51:29 on dist-test-slave-t7g5"
server_key: "09d5c9c9f36b62462c28eb68fea097ce"
server_key_iv: "83c2d97191902ccfb03f021e4d961788"
server_key_version: "encryptionkey@0"
I20260809 00:51:29.544384 31063 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:51:29.547755 31084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:29.548987 31063 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:51:29.549154 31063 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "64a1cd541e8040aabaf927fdd0bf7f38"
format_stamp: "Formatted at 2026-08-09 00:51:29 on dist-test-slave-t7g5"
server_key: "09d5c9c9f36b62462c28eb68fea097ce"
server_key_iv: "83c2d97191902ccfb03f021e4d961788"
server_key_version: "encryptionkey@0"
I20260809 00:51:29.549327 31063 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:29.568221 31063 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:29.571952 31063 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:29.572216 31063 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:29.590235 31063 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:33969
I20260809 00:51:29.590258 31172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:33969 every 8 connection(s)
I20260809 00:51:29.591605 31063 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:29.595232 31173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:29.595923 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31063
I20260809 00:51:29.596110 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:29.596683 29042 external_mini_cluster.cc:1428] Setting key 23ffe3e3d941486c0602c142d48abde4
I20260809 00:51:29.609623 31173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38: Bootstrap starting.
Aug 09 00:51:29 dist-test-slave-t7g5 krb5kdc[31043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236689, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:29.613627 31173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:29.615123 31173 log.cc:824] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:29.618708 31173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38: No bootstrap required, opened a new log
I20260809 00:51:29.622216 31178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:29.598468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41105 (local address 127.28.92.190:33969)
0809 00:51:29.599264 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:29.599276 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:29.599331 (+ 55us) server_negotiation.cc:407] Connection header received
0809 00:51:29.601475 (+ 2144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:29.601501 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:29.601991 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:29.602372 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:29.604174 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:29.605493 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:29.607321 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:29.608024 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:29.608165 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:29.613282 (+ 5117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:29.613294 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:29.613316 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:29.613367 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:29.617189 (+ 3822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:29.618177 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:29.618186 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:29.618195 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:29.618413 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:29.618841 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:29.618846 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:29.618849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:29.619605 (+ 756us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:29.619970 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:29.620374 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 00:51:29.620750 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":369,"threads_started":1}
I20260809 00:51:29.626351 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:29.628489 31173 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33969 } }
I20260809 00:51:29.629017 31173 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:29.629135 31173 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64a1cd541e8040aabaf927fdd0bf7f38, State: Initialized, Role: FOLLOWER
I20260809 00:51:29.629901 31173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33969 } }
I20260809 00:51:29.630227 31173 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:29.630389 31173 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:29.630587 31173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:29.633211 31173 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33969 } }
I20260809 00:51:29.633832 31173 leader_election.cc:302] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64a1cd541e8040aabaf927fdd0bf7f38; no voters:
I20260809 00:51:29.634483 31173 leader_election.cc:288] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:29.634608 31188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:29.636605 31173 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:29.636744 31188 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [term 1 LEADER]: Becoming Leader. State: Replica: 64a1cd541e8040aabaf927fdd0bf7f38, State: Running, Role: LEADER
I20260809 00:51:29.637355 31188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33969 } }
I20260809 00:51:29.640219 31189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33969 } } }
I20260809 00:51:29.640821 31190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64a1cd541e8040aabaf927fdd0bf7f38. Latest consensus state: current_term: 1 leader_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64a1cd541e8040aabaf927fdd0bf7f38" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33969 } } }
I20260809 00:51:29.641464 31189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:29.641546 31190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:29.642402 31201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:29.651679 31178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:29.631822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53089 (local address 127.28.92.190:33969)
0809 00:51:29.632032 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:29.632038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:29.633984 (+ 1946us) server_negotiation.cc:407] Connection header received
0809 00:51:29.634158 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:29.634164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:29.634257 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:29.634378 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:29.636419 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:29.637625 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:29.639405 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:29.640114 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:29.640250 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:29.643354 (+ 3104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:29.643361 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:29.643365 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:29.643404 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:29.647420 (+ 4016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:29.648558 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:29.648564 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:29.648572 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:29.648738 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:29.649365 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:29.649370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:29.649374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:29.649901 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:29.651143 (+ 1242us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:29.651282 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 00:51:29.651425 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:51:29.654994 31201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:29.665838 31201 catalog_manager.cc:1347] Generated new cluster ID: aa8e69f9e9ad4e33a36e9749183619ee
I20260809 00:51:29.665987 31201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:29.696411 31201 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:29.697970 31201 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:29.706319 31201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64a1cd541e8040aabaf927fdd0bf7f38: Generated new TSK 0
I20260809 00:51:29.707928 31201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:29.720816 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31063
I20260809 00:51:29.722034 31166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:29.816156 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31063
W20260809 00:51:29.841859 31041 connection.cc:535] client connection to 127.28.92.190:33969 recv error: Network error: failed to read from TLS socket (remote: 127.28.92.190:33969): Connection reset by peer (error 104)
2026-08-09T00:51:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2210 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:29 dist-test-slave-t7g5 krb5kdc[31222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:29 dist-test-slave-t7g5 krb5kdc[31222](info): set up 2 sockets
Aug 09 00:51:29 dist-test-slave-t7g5 krb5kdc[31222](info): commencing operation
krb5kdc: starting...
W20260809 00:51:31.040710 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.180s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:31 dist-test-slave-t7g5 krb5kdc[31222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:31.350982 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41439
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:41439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:31.691078 31239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:31.691358 31239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:31.691491 31239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:31.698758 31239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:31.698879 31239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:31.698961 31239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:31.699048 31239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:31.699107 31239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:31.708892 31239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:41439
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:41439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:31.710243 31239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:31.711535 31239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:31.723031 31246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:31.723176 31250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:31.723212 31247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:31.724133 31239 server_base.cc:1034] running on GCE node
I20260809 00:51:31.724900 31239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:31.726279 31239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:31.727471 31239 hybrid_clock.cc:648] HybridClock initialized: now 1786236691727427 us; error 32 us; skew 500 ppm
I20260809 00:51:31.727790 31239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:31 dist-test-slave-t7g5 krb5kdc[31222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236691, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:31.730726 31239 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:31.732323 31239 webserver.cc:460] Webserver started at http://127.28.92.190:41997/ using document root <none> and password file <none>
I20260809 00:51:31.732993 31239 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:31.733114 31239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:31.733560 31239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:31.736544 31239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "8f6a8001a22a4795ab955f0ca55d17c8"
format_stamp: "Formatted at 2026-08-09 00:51:31 on dist-test-slave-t7g5"
server_key: "ecce9a17e4f767648d66379d90a680ca"
server_key_iv: "abdd160941a322d88d042a051535b6aa"
server_key_version: "encryptionkey@0"
I20260809 00:51:31.737389 31239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "8f6a8001a22a4795ab955f0ca55d17c8"
format_stamp: "Formatted at 2026-08-09 00:51:31 on dist-test-slave-t7g5"
server_key: "ecce9a17e4f767648d66379d90a680ca"
server_key_iv: "abdd160941a322d88d042a051535b6aa"
server_key_version: "encryptionkey@0"
I20260809 00:51:31.742528 31239 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:51:31.745832 31261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:31.747076 31239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 00:51:31.747238 31239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "8f6a8001a22a4795ab955f0ca55d17c8"
format_stamp: "Formatted at 2026-08-09 00:51:31 on dist-test-slave-t7g5"
server_key: "ecce9a17e4f767648d66379d90a680ca"
server_key_iv: "abdd160941a322d88d042a051535b6aa"
server_key_version: "encryptionkey@0"
I20260809 00:51:31.747418 31239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:31.768612 31239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:31.772660 31239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:31.772949 31239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:31.790860 31239 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:41439
I20260809 00:51:31.790896 31343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:41439 every 8 connection(s)
I20260809 00:51:31.792222 31239 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:31.795982 31344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:31.799449 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31239
I20260809 00:51:31.799628 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:31.800079 29042 external_mini_cluster.cc:1428] Setting key c6e4b03dcedd4d4ea74c1db7ba8caae0
I20260809 00:51:31.807725 31344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8: Bootstrap starting.
I20260809 00:51:31.810679 31344 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:31.811766 31344 log.cc:824] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:31.812587 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:31.801945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51599 (local address 127.28.92.190:41439)
0809 00:51:31.802702 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:31.802713 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:31.802755 (+ 42us) server_negotiation.cc:407] Connection header received
0809 00:51:31.804472 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:31.804494 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:31.804886 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:31.805240 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:31.805804 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:31.807063 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:31.808365 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:31.809005 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:31.809178 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:31.810356 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:31.810363 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:31.810376 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:31.810921 (+ 545us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:31.810999 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:31.811027 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:31.811182 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:31.811455 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 00:51:31.811600 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":344,"threads_started":1}
I20260809 00:51:31.814733 31344 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8: No bootstrap required, opened a new log
I20260809 00:51:31.816416 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:31.822988 31344 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41439 } }
I20260809 00:51:31.823422 31344 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:31.823519 31344 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f6a8001a22a4795ab955f0ca55d17c8, State: Initialized, Role: FOLLOWER
I20260809 00:51:31.824059 31344 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41439 } }
I20260809 00:51:31.824280 31344 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:31.824421 31344 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:31.824591 31344 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:31.826877 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:31.820534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52867 (local address 127.28.92.190:41439)
0809 00:51:31.820718 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:31.820724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:31.821059 (+ 335us) server_negotiation.cc:407] Connection header received
0809 00:51:31.821194 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:31.821199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:31.821279 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:31.821409 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:31.821904 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:31.823014 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:31.824456 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:31.824964 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:31.825076 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:31.826181 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:31.826186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:31.826189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:31.826205 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:31.826261 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:31.826277 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:31.826369 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:31.826551 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 00:51:31.826603 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:51:31.826933 31344 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41439 } }
I20260809 00:51:31.827546 31344 leader_election.cc:302] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f6a8001a22a4795ab955f0ca55d17c8; no voters:
I20260809 00:51:31.828181 31344 leader_election.cc:288] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:31.828321 31363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:31.829006 31363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [term 1 LEADER]: Becoming Leader. State: Replica: 8f6a8001a22a4795ab955f0ca55d17c8, State: Running, Role: LEADER
I20260809 00:51:31.829504 31363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41439 } }
I20260809 00:51:31.830320 31344 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:31.832070 31364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41439 } } }
I20260809 00:51:31.832455 31364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:31.833940 31369 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:31.833894 31365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f6a8001a22a4795ab955f0ca55d17c8. Latest consensus state: current_term: 1 leader_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f6a8001a22a4795ab955f0ca55d17c8" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 41439 } } }
I20260809 00:51:31.834182 31365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:31.838403 31369 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:31.847183 31369 catalog_manager.cc:1347] Generated new cluster ID: 462284557b664beca7b832b4e711757a
I20260809 00:51:31.847297 31369 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:31.863622 31369 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:31.864840 31369 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:31.871714 31369 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f6a8001a22a4795ab955f0ca55d17c8: Generated new TSK 0
I20260809 00:51:31.872493 31369 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:31.882519 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31239
W20260809 00:51:31.883498 31339 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51599
W20260809 00:51:31.884203 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31239: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:31.884330 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31239
W20260809 00:51:31.907660 31219 connection.cc:535] client connection to 127.28.92.190:41439 recv error: Network error: failed to read from TLS socket (remote: 127.28.92.190:41439): Connection reset by peer (error 104)
2026-08-09T00:51:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2065 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:31 dist-test-slave-t7g5 krb5kdc[31400](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:31 dist-test-slave-t7g5 krb5kdc[31400](info): set up 2 sockets
Aug 09 00:51:31 dist-test-slave-t7g5 krb5kdc[31400](info): commencing operation
krb5kdc: starting...
W20260809 00:51:33.150517 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.006s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:33 dist-test-slave-t7g5 krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:33.468115 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35893
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:35893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:33.813444 31419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:33.813807 31419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:33.813954 31419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:33.821415 31419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:33.821554 31419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:33.821612 31419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:33.821727 31419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:33.821784 31419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:33.832173 31419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:35893
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:35893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:33.833566 31419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:33.834983 31419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:33.847419 31424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:33.847384 31427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:33.847568 31425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:33.848204 31419 server_base.cc:1034] running on GCE node
I20260809 00:51:33.849000 31419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:33.850489 31419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:33.851694 31419 hybrid_clock.cc:648] HybridClock initialized: now 1786236693851646 us; error 38 us; skew 500 ppm
I20260809 00:51:33.852044 31419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:33 dist-test-slave-t7g5 krb5kdc[31400](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236693, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:33.859436 31419 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:33.861045 31419 webserver.cc:460] Webserver started at http://127.28.92.190:46813/ using document root <none> and password file <none>
I20260809 00:51:33.861791 31419 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:33.861922 31419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:33.862233 31419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:33.865231 31419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "3ac1f5234c114d9c941993e78a4fd110"
format_stamp: "Formatted at 2026-08-09 00:51:33 on dist-test-slave-t7g5"
server_key: "8ce0aadc2f89c3b4bddc603b93ab1efb"
server_key_iv: "f00150ba57c30f0adeb4d0afde10172d"
server_key_version: "encryptionkey@0"
I20260809 00:51:33.866037 31419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "3ac1f5234c114d9c941993e78a4fd110"
format_stamp: "Formatted at 2026-08-09 00:51:33 on dist-test-slave-t7g5"
server_key: "8ce0aadc2f89c3b4bddc603b93ab1efb"
server_key_iv: "f00150ba57c30f0adeb4d0afde10172d"
server_key_version: "encryptionkey@0"
I20260809 00:51:33.871059 31419 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260809 00:51:33.874490 31437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:33.875818 31419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:51:33.875986 31419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "3ac1f5234c114d9c941993e78a4fd110"
format_stamp: "Formatted at 2026-08-09 00:51:33 on dist-test-slave-t7g5"
server_key: "8ce0aadc2f89c3b4bddc603b93ab1efb"
server_key_iv: "f00150ba57c30f0adeb4d0afde10172d"
server_key_version: "encryptionkey@0"
I20260809 00:51:33.876173 31419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:33.882081 31419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:33.886202 31419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:33.886503 31419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:33.904850 31419 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:35893
I20260809 00:51:33.904887 31523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:35893 every 8 connection(s)
I20260809 00:51:33.906299 31419 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:33.908255 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31419
I20260809 00:51:33.908469 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:33.909026 29042 external_mini_cluster.cc:1428] Setting key a6ca80f605a3e99e97f64a11b98134d1
I20260809 00:51:33.910792 31524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:33.916531 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:33.910854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56359 (local address 127.28.92.190:35893)
0809 00:51:33.911653 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:33.911664 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:33.911705 (+ 41us) server_negotiation.cc:407] Connection header received
0809 00:51:33.913288 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:33.913310 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:33.913641 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:33.914013 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:33.915023 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:33.915029 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:33.915046 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:33.915068 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:33.915139 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:33.915161 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:33.915326 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:33.915426 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 00:51:33.915608 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":336,"threads_started":1}
I20260809 00:51:33.920182 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:33.923079 31524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110: Bootstrap starting.
I20260809 00:51:33.926769 31524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:33.926831 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:33.924485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34901 (local address 127.28.92.190:35893)
0809 00:51:33.924676 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:33.924682 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:33.925026 (+ 344us) server_negotiation.cc:407] Connection header received
0809 00:51:33.925197 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:33.925201 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:33.925248 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:33.925323 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:33.926212 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:33.926216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:33.926219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:33.926234 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:33.926283 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:33.926303 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:33.926389 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:33.926520 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 00:51:33.926564 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 00:51:33.928100 31524 log.cc:824] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:33.930812 31524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110: No bootstrap required, opened a new log
I20260809 00:51:33.938025 31524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1f5234c114d9c941993e78a4fd110" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35893 } }
I20260809 00:51:33.938474 31524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:33.938567 31524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac1f5234c114d9c941993e78a4fd110, State: Initialized, Role: FOLLOWER
I20260809 00:51:33.939111 31524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1f5234c114d9c941993e78a4fd110" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35893 } }
I20260809 00:51:33.939324 31524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:33.939455 31524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:33.939615 31524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:33.941762 31524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1f5234c114d9c941993e78a4fd110" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35893 } }
I20260809 00:51:33.942256 31524 leader_election.cc:302] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ac1f5234c114d9c941993e78a4fd110; no voters:
I20260809 00:51:33.942863 31524 leader_election.cc:288] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:33.942999 31543 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:33.944054 31543 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [term 1 LEADER]: Becoming Leader. State: Replica: 3ac1f5234c114d9c941993e78a4fd110, State: Running, Role: LEADER
I20260809 00:51:33.944547 31543 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1f5234c114d9c941993e78a4fd110" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35893 } }
I20260809 00:51:33.945050 31524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:33.947484 31544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ac1f5234c114d9c941993e78a4fd110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1f5234c114d9c941993e78a4fd110" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35893 } } }
I20260809 00:51:33.947474 31549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ac1f5234c114d9c941993e78a4fd110. Latest consensus state: current_term: 1 leader_uuid: "3ac1f5234c114d9c941993e78a4fd110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ac1f5234c114d9c941993e78a4fd110" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 35893 } } }
I20260809 00:51:33.947935 31544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:33.947990 31549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:33.950333 31556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:33.955307 31556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:33.963714 31556 catalog_manager.cc:1347] Generated new cluster ID: 1475b45784c440fdb7eabcfa6a4a694e
I20260809 00:51:33.963830 31556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:33.986536 31556 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:33.986969 31556 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:34.004141 31556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ac1f5234c114d9c941993e78a4fd110: Generated new TSK 0
I20260809 00:51:34.005043 31556 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:34.014130 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31419
W20260809 00:51:34.015234 31517 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56359
W20260809 00:51:34.016005 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31419: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:34.016152 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31419
2026-08-09T00:51:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2135 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:34 dist-test-slave-t7g5 krb5kdc[31576](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:34 dist-test-slave-t7g5 krb5kdc[31576](info): set up 2 sockets
Aug 09 00:51:34 dist-test-slave-t7g5 krb5kdc[31576](info): commencing operation
krb5kdc: starting...
W20260809 00:51:35.255554 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.194s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:35 dist-test-slave-t7g5 krb5kdc[31576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:35.561751 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33311
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:43345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:33311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:35.896629 31595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:35.897001 31595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:35.897151 31595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:35.904603 31595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:35.904732 31595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:35.904796 31595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:35.904887 31595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:35.904948 31595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:35.914949 31595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:43345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:33311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:35.916292 31595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:35.917618 31595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:35.929193 31605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:35.929230 31604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:35.929155 31608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:35.930333 31595 server_base.cc:1034] running on GCE node
I20260809 00:51:35.931118 31595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:35.932524 31595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:35.933779 31595 hybrid_clock.cc:648] HybridClock initialized: now 1786236695933722 us; error 48 us; skew 500 ppm
I20260809 00:51:35.934141 31595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:35 dist-test-slave-t7g5 krb5kdc[31576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236695, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:35.937233 31595 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:35.938702 31595 webserver.cc:460] Webserver started at http://127.28.92.190:41313/ using document root <none> and password file <none>
I20260809 00:51:35.939345 31595 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:35.939459 31595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:35.939713 31595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:35.942696 31595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "3de510fea417451fa83bfa8ad6bde318"
format_stamp: "Formatted at 2026-08-09 00:51:35 on dist-test-slave-t7g5"
server_key: "37bf2cf6d2dfaf777b0626c53f02bca5"
server_key_iv: "3ad1ad2a820a3536d86293297fb9ead1"
server_key_version: "encryptionkey@0"
I20260809 00:51:35.943404 31595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "3de510fea417451fa83bfa8ad6bde318"
format_stamp: "Formatted at 2026-08-09 00:51:35 on dist-test-slave-t7g5"
server_key: "37bf2cf6d2dfaf777b0626c53f02bca5"
server_key_iv: "3ad1ad2a820a3536d86293297fb9ead1"
server_key_version: "encryptionkey@0"
I20260809 00:51:35.948518 31595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260809 00:51:35.952205 31621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:35.953467 31595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:51:35.953617 31595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "3de510fea417451fa83bfa8ad6bde318"
format_stamp: "Formatted at 2026-08-09 00:51:35 on dist-test-slave-t7g5"
server_key: "37bf2cf6d2dfaf777b0626c53f02bca5"
server_key_iv: "3ad1ad2a820a3536d86293297fb9ead1"
server_key_version: "encryptionkey@0"
I20260809 00:51:35.953824 31595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:35.975745 31595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:35.980098 31595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:35.980345 31595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:35.998184 31595 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:33311
I20260809 00:51:35.998216 31706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:33311 every 8 connection(s)
I20260809 00:51:35.999647 31595 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:36.003391 31707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:36.008873 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31595
I20260809 00:51:36.009064 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:36.009595 29042 external_mini_cluster.cc:1428] Setting key 1d9506dcf8f5855d512c0cef1528968f
I20260809 00:51:36.014815 31707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318: Bootstrap starting.
I20260809 00:51:36.018070 31707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:36.019052 31707 log.cc:824] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:36.021934 31707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318: No bootstrap required, opened a new log
Aug 09 00:51:36 dist-test-slave-t7g5 krb5kdc[31576](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:36.031718 31707 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3de510fea417451fa83bfa8ad6bde318" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33311 } }
I20260809 00:51:36.032173 31707 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:36.032284 31707 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3de510fea417451fa83bfa8ad6bde318, State: Initialized, Role: FOLLOWER
I20260809 00:51:36.032924 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:36.011537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57311 (local address 127.28.92.190:33311)
0809 00:51:36.012409 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:36.012421 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:36.012472 (+ 51us) server_negotiation.cc:407] Connection header received
0809 00:51:36.014235 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:36.014260 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:36.014692 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:36.015060 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:36.016575 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:36.017929 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:36.019278 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:36.020170 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:36.020323 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:36.024359 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:36.024370 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:36.024391 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:36.024445 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:36.028470 (+ 4025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:36.029124 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:36.029134 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:36.029147 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:36.029379 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:36.029721 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:36.029726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:36.029730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:36.030478 (+ 748us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:36.030777 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:36.031143 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 00:51:36.031589 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":406,"threads_started":1}
I20260809 00:51:36.032979 31707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3de510fea417451fa83bfa8ad6bde318" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33311 } }
I20260809 00:51:36.033270 31707 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:36.033432 31707 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:36.033617 31707 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:36.036162 31707 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3de510fea417451fa83bfa8ad6bde318" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33311 } }
I20260809 00:51:36.036680 31707 leader_election.cc:302] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3de510fea417451fa83bfa8ad6bde318; no voters:
I20260809 00:51:36.036785 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:36.037276 31707 leader_election.cc:288] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:36.037436 31713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:36.039217 31707 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:36.045053 31713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [term 1 LEADER]: Becoming Leader. State: Replica: 3de510fea417451fa83bfa8ad6bde318, State: Running, Role: LEADER
I20260809 00:51:36.045758 31713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3de510fea417451fa83bfa8ad6bde318" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33311 } }
I20260809 00:51:36.048493 31714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3de510fea417451fa83bfa8ad6bde318" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3de510fea417451fa83bfa8ad6bde318" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33311 } } }
I20260809 00:51:36.048875 31714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:36.049360 31715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3de510fea417451fa83bfa8ad6bde318. Latest consensus state: current_term: 1 leader_uuid: "3de510fea417451fa83bfa8ad6bde318" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3de510fea417451fa83bfa8ad6bde318" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33311 } } }
I20260809 00:51:36.049639 31715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:36.059860 31727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:36.065346 31727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:36.076975 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:36.045397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56779 (local address 127.28.92.190:33311)
0809 00:51:36.045593 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:36.045600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:36.058636 (+ 13036us) server_negotiation.cc:407] Connection header received
0809 00:51:36.059584 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:36.059591 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:36.059694 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:36.059768 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:36.062142 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:36.063384 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:36.065308 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:36.066093 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:36.066223 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:36.069632 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:36.069640 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:36.069645 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:36.069711 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:36.073502 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:36.074408 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:36.074413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:36.074416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:36.074575 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:36.075070 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:36.075076 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:36.075080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:36.075505 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:36.075750 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:36.076377 (+ 627us) server_negotiation.cc:299] Negotiation successful
0809 00:51:36.076617 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:51:36.079270 31727 catalog_manager.cc:1347] Generated new cluster ID: d3dcac56290442eaafec0683edccd36a
I20260809 00:51:36.079456 31727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:36.090231 31727 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:36.091470 31727 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:36.097694 31727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3de510fea417451fa83bfa8ad6bde318: Generated new TSK 0
I20260809 00:51:36.098423 31727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:36.106513 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31595
I20260809 00:51:36.107586 31696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:36.204403 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31595
2026-08-09T00:51:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2187 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:36 dist-test-slave-t7g5 krb5kdc[31749](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:36 dist-test-slave-t7g5 krb5kdc[31749](info): set up 2 sockets
Aug 09 00:51:36 dist-test-slave-t7g5 krb5kdc[31749](info): commencing operation
krb5kdc: starting...
W20260809 00:51:37.440821 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.005s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:37 dist-test-slave-t7g5 krb5kdc[31749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:37.740471 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34267
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:37125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:34267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:38.078224 31774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:38.078518 31774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:38.078656 31774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:38.085772 31774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:38.085894 31774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:38.085976 31774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:38.086056 31774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:38.086117 31774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:38.095961 31774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:37125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:34267
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:34267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:38.097276 31774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:38.098647 31774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:38.110172 31781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:38.110216 31782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:38.110236 31785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:38.111297 31774 server_base.cc:1034] running on GCE node
I20260809 00:51:38.112088 31774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:38.113456 31774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:38.114653 31774 hybrid_clock.cc:648] HybridClock initialized: now 1786236698114607 us; error 35 us; skew 500 ppm
I20260809 00:51:38.114992 31774 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:38 dist-test-slave-t7g5 krb5kdc[31749](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236698, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:38.118057 31774 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:38.119535 31774 webserver.cc:460] Webserver started at http://127.28.92.190:43399/ using document root <none> and password file <none>
I20260809 00:51:38.120220 31774 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:38.120343 31774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:38.120656 31774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:38.123696 31774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "ceacc84008e3492aa729d1768bf8b078"
format_stamp: "Formatted at 2026-08-09 00:51:38 on dist-test-slave-t7g5"
server_key: "4a87e48f1111ea93e1fba3359f571513"
server_key_iv: "b0e252452d81a8be4b3eee088a22f223"
server_key_version: "encryptionkey@0"
I20260809 00:51:38.124437 31774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "ceacc84008e3492aa729d1768bf8b078"
format_stamp: "Formatted at 2026-08-09 00:51:38 on dist-test-slave-t7g5"
server_key: "4a87e48f1111ea93e1fba3359f571513"
server_key_iv: "b0e252452d81a8be4b3eee088a22f223"
server_key_version: "encryptionkey@0"
I20260809 00:51:38.129457 31774 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:51:38.132902 31797 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:38.134232 31774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:38.134398 31774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "ceacc84008e3492aa729d1768bf8b078"
format_stamp: "Formatted at 2026-08-09 00:51:38 on dist-test-slave-t7g5"
server_key: "4a87e48f1111ea93e1fba3359f571513"
server_key_iv: "b0e252452d81a8be4b3eee088a22f223"
server_key_version: "encryptionkey@0"
I20260809 00:51:38.134582 31774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:38.150346 31774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:38.154623 31774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:38.154908 31774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:38.173182 31774 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:34267
I20260809 00:51:38.173205 31882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:34267 every 8 connection(s)
I20260809 00:51:38.174609 31774 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:38.177865 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31774
I20260809 00:51:38.178026 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:38.178354 31883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:38.178486 29042 external_mini_cluster.cc:1428] Setting key 60adcea53b3bc0b9cbd1891fb57d3f39
I20260809 00:51:38.192207 31883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078: Bootstrap starting.
I20260809 00:51:38.192564 31888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:38.180201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50151 (local address 127.28.92.190:34267)
0809 00:51:38.180979 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:38.180993 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:38.181035 (+ 42us) server_negotiation.cc:407] Connection header received
0809 00:51:38.182975 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:38.182997 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:38.183377 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:38.183740 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:38.184267 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:38.185591 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:38.187413 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:38.188084 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:38.188213 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:38.189602 (+ 1389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:38.189614 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:38.189637 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:38.190381 (+ 744us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:38.190477 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:38.190516 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:38.190630 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:38.190960 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 00:51:38.191235 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":341,"threads_started":1}
I20260809 00:51:38.196379 31883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:38.197166 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:38.197639 31883 log.cc:824] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:38.201012 31883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078: No bootstrap required, opened a new log
I20260809 00:51:38.208418 31888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:38.202058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41803 (local address 127.28.92.190:34267)
0809 00:51:38.202227 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:38.202233 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:38.202625 (+ 392us) server_negotiation.cc:407] Connection header received
0809 00:51:38.202761 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:38.202770 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:38.202854 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:38.202977 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:38.203443 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:38.204580 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:38.205914 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:38.206643 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:38.206772 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:38.207698 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:38.207704 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:38.207709 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:38.207731 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:38.207782 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:38.207802 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:38.207903 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:38.207993 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 00:51:38.208087 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:51:38.210556 31883 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceacc84008e3492aa729d1768bf8b078" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34267 } }
I20260809 00:51:38.210927 31883 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:38.211009 31883 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceacc84008e3492aa729d1768bf8b078, State: Initialized, Role: FOLLOWER
I20260809 00:51:38.211534 31883 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceacc84008e3492aa729d1768bf8b078" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34267 } }
I20260809 00:51:38.211750 31883 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:38.211869 31883 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:38.211998 31883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:38.214547 31883 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceacc84008e3492aa729d1768bf8b078" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34267 } }
I20260809 00:51:38.215015 31883 leader_election.cc:302] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceacc84008e3492aa729d1768bf8b078; no voters:
I20260809 00:51:38.215538 31883 leader_election.cc:288] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:38.215662 31895 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:38.216327 31895 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [term 1 LEADER]: Becoming Leader. State: Replica: ceacc84008e3492aa729d1768bf8b078, State: Running, Role: LEADER
I20260809 00:51:38.216890 31895 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceacc84008e3492aa729d1768bf8b078" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34267 } }
I20260809 00:51:38.217554 31883 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:38.219566 31896 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceacc84008e3492aa729d1768bf8b078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceacc84008e3492aa729d1768bf8b078" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34267 } } }
I20260809 00:51:38.219626 31898 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceacc84008e3492aa729d1768bf8b078. Latest consensus state: current_term: 1 leader_uuid: "ceacc84008e3492aa729d1768bf8b078" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceacc84008e3492aa729d1768bf8b078" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 34267 } } }
I20260809 00:51:38.219985 31898 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:38.219983 31896 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078 [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:38.222741 31908 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:38.227044 31908 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:38.236173 31908 catalog_manager.cc:1347] Generated new cluster ID: 111b0bf3d48e41ddb06bb9e50d62db75
I20260809 00:51:38.236311 31908 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:38.275625 31908 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:38.276954 31908 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:38.285990 31908 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceacc84008e3492aa729d1768bf8b078: Generated new TSK 0
I20260809 00:51:38.286808 31908 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:38.298825 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31774
W20260809 00:51:38.299993 31878 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50151
W20260809 00:51:38.300710 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31774: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:38.300853 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31774
2026-08-09T00:51:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2093 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:38 dist-test-slave-t7g5 krb5kdc[31928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:38 dist-test-slave-t7g5 krb5kdc[31928](info): set up 2 sockets
Aug 09 00:51:38 dist-test-slave-t7g5 krb5kdc[31928](info): commencing operation
krb5kdc: starting...
W20260809 00:51:39.525924 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.183s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:39 dist-test-slave-t7g5 krb5kdc[31928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:39.842355 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36427
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:39867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:36427
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:40.193568 31953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:40.194041 31953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:40.194167 31953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:40.203006 31953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:40.203138 31953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:40.203187 31953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:40.203250 31953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:40.203298 31953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:40.213641 31953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:39867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:36427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:36427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:40.215029 31953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:40.216387 31953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:40.228186 31960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:40.228173 31961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:40.228132 31964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:40.229306 31953 server_base.cc:1034] running on GCE node
I20260809 00:51:40.230197 31953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:40.231643 31953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:40.232834 31953 hybrid_clock.cc:648] HybridClock initialized: now 1786236700232792 us; error 43 us; skew 500 ppm
I20260809 00:51:40.233179 31953 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:40 dist-test-slave-t7g5 krb5kdc[31928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236700, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:40.240273 31953 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:40.241882 31953 webserver.cc:460] Webserver started at http://127.28.92.190:36551/ using document root <none> and password file <none>
I20260809 00:51:40.242601 31953 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:40.242731 31953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:40.243063 31953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:40.246232 31953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "879a554f9322417eb546ecc41215ce8f"
format_stamp: "Formatted at 2026-08-09 00:51:40 on dist-test-slave-t7g5"
server_key: "90cb05500292b8328b82f4cbbaa2e26b"
server_key_iv: "ce1a01044a78da4367ec75e1f2a348db"
server_key_version: "encryptionkey@0"
I20260809 00:51:40.247038 31953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "879a554f9322417eb546ecc41215ce8f"
format_stamp: "Formatted at 2026-08-09 00:51:40 on dist-test-slave-t7g5"
server_key: "90cb05500292b8328b82f4cbbaa2e26b"
server_key_iv: "ce1a01044a78da4367ec75e1f2a348db"
server_key_version: "encryptionkey@0"
I20260809 00:51:40.252497 31953 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260809 00:51:40.256080 31971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:40.257445 31953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 00:51:40.257625 31953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "879a554f9322417eb546ecc41215ce8f"
format_stamp: "Formatted at 2026-08-09 00:51:40 on dist-test-slave-t7g5"
server_key: "90cb05500292b8328b82f4cbbaa2e26b"
server_key_iv: "ce1a01044a78da4367ec75e1f2a348db"
server_key_version: "encryptionkey@0"
I20260809 00:51:40.257861 31953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:40.263530 31953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:40.267499 31953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:40.267776 31953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:40.285096 31953 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:36427
I20260809 00:51:40.285120 32057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:36427 every 8 connection(s)
I20260809 00:51:40.286501 31953 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:40.290143 32059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:40.294097 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 31953
I20260809 00:51:40.294262 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:40.294678 29042 external_mini_cluster.cc:1428] Setting key bae12f7a28b89218a1a8dee19088c841
I20260809 00:51:40.302342 32059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f: Bootstrap starting.
I20260809 00:51:40.304275 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:40.296490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37987 (local address 127.28.92.190:36427)
0809 00:51:40.297352 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:40.297368 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:40.297431 (+ 63us) server_negotiation.cc:407] Connection header received
0809 00:51:40.300467 (+ 3036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:40.300498 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:40.300937 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:40.301357 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:40.302372 (+ 1015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:40.302391 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:40.302407 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:40.302427 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:40.302501 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:40.302534 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:40.302750 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:40.302882 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 00:51:40.303071 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":366,"threads_started":1}
I20260809 00:51:40.306177 32059 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:40.307401 32059 log.cc:824] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:40.308182 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:40.310127 32059 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f: No bootstrap required, opened a new log
I20260809 00:51:40.314903 32064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:40.312448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42577 (local address 127.28.92.190:36427)
0809 00:51:40.312639 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:40.312645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:40.313017 (+ 372us) server_negotiation.cc:407] Connection header received
0809 00:51:40.313165 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:40.313170 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:40.313243 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:40.313353 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:40.314235 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:40.314240 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:40.314245 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 00:51:40.314267 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:40.314322 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 00:51:40.314342 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:40.314469 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:40.314518 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 00:51:40.314579 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 00:51:40.318390 32059 raft_consensus.cc:348] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "879a554f9322417eb546ecc41215ce8f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36427 } }
I20260809 00:51:40.318754 32059 raft_consensus.cc:374] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 00:51:40.318858 32059 raft_consensus.cc:729] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879a554f9322417eb546ecc41215ce8f, State: Initialized, Role: FOLLOWER
I20260809 00:51:40.319429 32059 consensus_queue.cc:260] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "879a554f9322417eb546ecc41215ce8f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36427 } }
I20260809 00:51:40.319666 32059 raft_consensus.cc:388] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 00:51:40.319800 32059 raft_consensus.cc:482] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 00:51:40.319978 32059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:40.322317 32059 raft_consensus.cc:504] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "879a554f9322417eb546ecc41215ce8f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36427 } }
I20260809 00:51:40.322831 32059 leader_election.cc:302] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 879a554f9322417eb546ecc41215ce8f; no voters:
I20260809 00:51:40.323405 32059 leader_election.cc:288] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 00:51:40.323522 32074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:40.324167 32074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [term 1 LEADER]: Becoming Leader. State: Replica: 879a554f9322417eb546ecc41215ce8f, State: Running, Role: LEADER
I20260809 00:51:40.324709 32074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "879a554f9322417eb546ecc41215ce8f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36427 } }
I20260809 00:51:40.325496 32059 sys_catalog.cc:564] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:40.327652 32075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "879a554f9322417eb546ecc41215ce8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "879a554f9322417eb546ecc41215ce8f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36427 } } }
I20260809 00:51:40.328087 32075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:40.331444 32077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 879a554f9322417eb546ecc41215ce8f. Latest consensus state: current_term: 1 leader_uuid: "879a554f9322417eb546ecc41215ce8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "879a554f9322417eb546ecc41215ce8f" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 36427 } } }
I20260809 00:51:40.331782 32077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:40.333333 32083 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:40.338696 32083 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:40.347704 32083 catalog_manager.cc:1347] Generated new cluster ID: 8355e041fa8640aa81ef76d76d0e7ca7
I20260809 00:51:40.347841 32083 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:40.385759 32083 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:40.386353 32083 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:40.405337 32083 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 879a554f9322417eb546ecc41215ce8f: Generated new TSK 0
I20260809 00:51:40.406510 32083 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:40.420168 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31953
W20260809 00:51:40.421270 32048 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:37987
W20260809 00:51:40.422012 29042 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 31953: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 00:51:40.422168 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 31953
2026-08-09T00:51:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2121 ms)
[----------] 18 tests from AuthTokenIssuingTest (38442 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:40 dist-test-slave-t7g5 krb5kdc[32111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:40 dist-test-slave-t7g5 krb5kdc[32111](info): set up 2 sockets
Aug 09 00:51:40 dist-test-slave-t7g5 krb5kdc[32111](info): commencing operation
krb5kdc: starting...
W20260809 00:51:41.692905 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:41 dist-test-slave-t7g5 krb5kdc[32111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:42.009223 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:44847
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:44847,127.28.92.189:35303,127.28.92.188:35687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:42.355341 32129 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 00:51:42.355734 32129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:42.355839 32129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:42.355955 32129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:42.363421 32129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:42.363528 32129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:42.363622 32129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:42.363698 32129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:42.363787 32129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:42.373831 32129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:44847,127.28.92.189:35303,127.28.92.188:35687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:44847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:42.375125 32129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:42.376485 32129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:42.387760 32136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:42.387720 32138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:42.387807 32141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:42.388829 32129 server_base.cc:1034] running on GCE node
I20260809 00:51:42.389644 32129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:42.391220 32129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:42.392500 32129 hybrid_clock.cc:648] HybridClock initialized: now 1786236702392412 us; error 45 us; skew 500 ppm
I20260809 00:51:42.392904 32129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:42 dist-test-slave-t7g5 krb5kdc[32111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:42.396293 32129 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:42.397746 32129 webserver.cc:460] Webserver started at http://127.28.92.190:36983/ using document root <none> and password file <none>
I20260809 00:51:42.398417 32129 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:42.398514 32129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:42.398810 32129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:42.401849 32129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "3a53323a5ad0452cb915fcac1227998e"
format_stamp: "Formatted at 2026-08-09 00:51:42 on dist-test-slave-t7g5"
server_key: "c703e4bb7bcb919147547b4e67392fe3"
server_key_iv: "7013c5e37606bd54928052383182f7d8"
server_key_version: "encryptionkey@0"
I20260809 00:51:42.402644 32129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "3a53323a5ad0452cb915fcac1227998e"
format_stamp: "Formatted at 2026-08-09 00:51:42 on dist-test-slave-t7g5"
server_key: "c703e4bb7bcb919147547b4e67392fe3"
server_key_iv: "7013c5e37606bd54928052383182f7d8"
server_key_version: "encryptionkey@0"
I20260809 00:51:42.407821 32129 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 00:51:42.411402 32152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:42.412825 32129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 00:51:42.412997 32129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "3a53323a5ad0452cb915fcac1227998e"
format_stamp: "Formatted at 2026-08-09 00:51:42 on dist-test-slave-t7g5"
server_key: "c703e4bb7bcb919147547b4e67392fe3"
server_key_iv: "7013c5e37606bd54928052383182f7d8"
server_key_version: "encryptionkey@0"
I20260809 00:51:42.413203 32129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:42.428455 32129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:42.432827 32129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:42.433091 32129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:42.450441 32129 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:44847
I20260809 00:51:42.450486 32233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:44847 every 8 connection(s)
I20260809 00:51:42.451802 32129 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:42.455519 32235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:42.460480 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 32129
I20260809 00:51:42.460672 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:42.461310 29042 external_mini_cluster.cc:1428] Setting key ed29ce9151e1bbbb6d7e51644d1305c9
I20260809 00:51:42.462232 32235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:42 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.28.92.189@KRBTEST.COM; defaulting to no policy
I20260809 00:51:42.497021 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.465500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44847 (local address 127.0.0.1:51778)
0809 00:51:42.478020 (+ 12520us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.478083 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:42.480011 (+ 1928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:42.480998 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:42.481004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:42.481587 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:42.482002 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:42.482021 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.484121 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.484125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:42.485205 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:42.485218 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.486431 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.486436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:42.486559 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:42.487173 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:42.487196 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:42.489600 (+ 2404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:42.492862 (+ 3262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:42.492884 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:42.492898 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:42.493439 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:42.493938 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:42.493942 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:42.493946 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:42.494150 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:42.494978 (+ 828us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:42.494987 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:42.495242 (+ 255us) client_negotiation.cc:769] Sending connection context
0809 00:51:42.495543 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 00:51:42.496079 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12176,"mutex_wait_us":121,"thread_start_us":11930,"threads_started":1}
I20260809 00:51:42.497047 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.465500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51778 (local address 127.28.92.190:44847)
0809 00:51:42.477541 (+ 12041us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:42.477559 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:42.478244 (+ 685us) server_negotiation.cc:407] Connection header received
0809 00:51:42.480430 (+ 2186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:42.480438 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:42.480751 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:42.480976 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:42.482216 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.483968 (+ 1752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.485349 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.486223 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.486401 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:42.489843 (+ 3442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:42.489851 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:42.489863 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:42.489893 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:42.492680 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:42.493585 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:42.493593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:42.493595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:42.493810 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:42.494273 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:42.494277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:42.494280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:42.494827 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:42.494986 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:42.495652 (+ 666us) server_negotiation.cc:299] Negotiation successful
0809 00:51:42.495907 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11723,"thread_start_us":11407,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.189@KRBTEST.COM" created.
I20260809 00:51:42.500247 32235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:42.501333 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.500950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42762)
0809 00:51:42.501115 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.501224 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 00:51:42.501593 32154 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
I20260809 00:51:42.503119 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.502770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42774)
0809 00:51:42.502916 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.502982 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 00:51:42.503301 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:35303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab.
Entry for principal kudu/127.28.92.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab.
I20260809 00:51:42.532336 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:35303
--webserver_interface=127.28.92.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab
--principal=kudu/127.28.92.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:44847,127.28.92.189:35303,127.28.92.188:35687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:51:42.552677 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } attempt: 1
I20260809 00:51:42.554081 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.553504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42786)
0809 00:51:42.553750 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.553922 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 00:51:42.555107 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.554719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42788)
0809 00:51:42.554874 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.554962 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 00:51:42.555284 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:35303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
I20260809 00:51:42.623541 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } attempt: 2
I20260809 00:51:42.624838 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.624259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42798)
0809 00:51:42.624527 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.624644 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 00:51:42.625900 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.625445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42802)
0809 00:51:42.625614 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.625733 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 00:51:42.626144 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:35303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
I20260809 00:51:42.717410 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } attempt: 3
I20260809 00:51:42.718691 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.718171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42818)
0809 00:51:42.718406 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.718523 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260809 00:51:42.719719 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.719299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42832)
0809 00:51:42.719458 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.719546 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 00:51:42.719920 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:35303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
I20260809 00:51:42.863207 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } attempt: 4
I20260809 00:51:42.864529 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.863889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42834)
0809 00:51:42.864232 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.864354 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177}
I20260809 00:51:42.865597 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.865161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42846)
0809 00:51:42.865340 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.865440 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 00:51:42.865877 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:35303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:35303: connect: Connection refused (error 111)
W20260809 00:51:42.874608 32243 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 00:51:42.874934 32243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:42.875010 32243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:42.875092 32243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:42.882344 32243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:42.882431 32243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:42.882495 32243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:42.882545 32243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:42.882607 32243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:42.892549 32243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:44847,127.28.92.189:35303,127.28.92.188:35687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab
--principal=kudu/127.28.92.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:35303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.92.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:42.893824 32243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:42.895166 32243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:42.906757 32255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:42.906667 32261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:42.906709 32258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:42.907429 32243 server_base.cc:1034] running on GCE node
I20260809 00:51:42.908171 32243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:42.909520 32243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:42.910797 32243 hybrid_clock.cc:648] HybridClock initialized: now 1786236702910689 us; error 40 us; skew 500 ppm
I20260809 00:51:42.911125 32243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:42 dist-test-slave-t7g5 krb5kdc[32111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:42.914407 32243 init.cc:377] Logged in from keytab as kudu/127.28.92.189@KRBTEST.COM (short username kudu)
I20260809 00:51:42.915968 32243 webserver.cc:460] Webserver started at http://127.28.92.189:41043/ using document root <none> and password file <none>
I20260809 00:51:42.916712 32243 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:42.916811 32243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:42.917130 32243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:42.920233 32243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data/instance:
uuid: "90f96016fe964a07a9ec244a3f051d76"
format_stamp: "Formatted at 2026-08-09 00:51:42 on dist-test-slave-t7g5"
server_key: "c79f71ec74a7e8a7ef6a7cfa0adafdc0"
server_key_iv: "2cb92b025cfb3f5539944e274855ef06"
server_key_version: "encryptionkey@0"
I20260809 00:51:42.921032 32243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal/instance:
uuid: "90f96016fe964a07a9ec244a3f051d76"
format_stamp: "Formatted at 2026-08-09 00:51:42 on dist-test-slave-t7g5"
server_key: "c79f71ec74a7e8a7ef6a7cfa0adafdc0"
server_key_iv: "2cb92b025cfb3f5539944e274855ef06"
server_key_version: "encryptionkey@0"
I20260809 00:51:42.926213 32243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260809 00:51:42.929502 32270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:42.930792 32243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:51:42.930954 32243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal
uuid: "90f96016fe964a07a9ec244a3f051d76"
format_stamp: "Formatted at 2026-08-09 00:51:42 on dist-test-slave-t7g5"
server_key: "c79f71ec74a7e8a7ef6a7cfa0adafdc0"
server_key_iv: "2cb92b025cfb3f5539944e274855ef06"
server_key_version: "encryptionkey@0"
I20260809 00:51:42.931154 32243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:42.943785 32243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:42.947418 32243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:42.947655 32243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:42.964497 32243 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.189:35303
I20260809 00:51:42.964517 32352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.189:35303 every 8 connection(s)
I20260809 00:51:42.965839 32243 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
I20260809 00:51:42.969332 32354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:42.973444 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 32243
I20260809 00:51:42.973632 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-1/wal/instance
I20260809 00:51:42.974203 29042 external_mini_cluster.cc:1428] Setting key edb55bc65e8dc28dc54056d020f0d7ea
I20260809 00:51:42.976851 32354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:42 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:42.997268 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.979907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.28.92.190:44847)
0809 00:51:42.980103 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:42.980109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:42.981312 (+ 1203us) server_negotiation.cc:407] Connection header received
0809 00:51:42.983258 (+ 1946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:42.983264 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:42.983348 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:42.983437 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:42.984914 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.985597 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.987085 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.987506 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.987615 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:42.991551 (+ 3936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:42.991557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:42.991560 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:42.991595 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:42.994229 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:42.995054 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:42.995057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:42.995059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:42.995178 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:42.995614 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:42.995617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:42.995619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:42.995890 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:42.995997 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:42.996840 (+ 843us) server_negotiation.cc:299] Negotiation successful
0809 00:51:42.997028 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:51:42.998917 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:42.980355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44847 (local address 127.0.0.1:51782)
0809 00:51:42.981133 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:42.981177 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:42.982986 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:42.983678 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:42.983686 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:42.984188 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:42.984737 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:42.984753 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.985776 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.985781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:42.986936 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:42.986949 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:42.987727 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:42.987735 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:42.987956 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:42.988599 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:42.988621 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:42.991289 (+ 2668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:42.994372 (+ 3083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:42.994388 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:42.994404 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:42.994959 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:42.995274 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:42.995279 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:42.995283 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:42.995525 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:42.996023 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:42.996030 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:42.996451 (+ 421us) client_negotiation.cc:769] Sending connection context
0809 00:51:42.996760 (+ 309us) client_negotiation.cc:240] Negotiation successful
0809 00:51:42.997507 (+ 747us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":320,"threads_started":1}
I20260809 00:51:43.000792 32354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.92.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.188@KRBTEST.COM" created.
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:51:43.016527 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.001674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42848)
0809 00:51:43.001854 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.001872 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.001977 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.002920 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.002926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.003428 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.003620 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.003632 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.005040 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.005046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.006406 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.006423 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.007246 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.007252 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.007476 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.008028 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.008047 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.010805 (+ 2758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.014045 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.014051 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.014055 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.014408 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.014771 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.014776 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.014780 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.014933 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.015583 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.015588 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.015732 (+ 144us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.015854 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.016133 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 00:51:43.016654 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.001878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42848 (local address 127.28.92.189:35303)
0809 00:51:43.002507 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.002512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.002537 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:51:43.002583 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.002588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.002757 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.002869 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.003797 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.004887 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.006540 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.007088 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.007183 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.011048 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.011061 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.011076 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.011105 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.013929 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.014541 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.014548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.014550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.014668 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.015040 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.015044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.015046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.015442 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.015675 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.016016 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.016264 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":376,"threads_started":1}
I20260809 00:51:43.018967 32354 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:43.020180 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.019712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55514)
0809 00:51:43.019901 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.020021 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 00:51:43.020498 32273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.022058 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.021751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55522)
0809 00:51:43.021885 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.021953 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 00:51:43.022301 32354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab.
Entry for principal kudu/127.28.92.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab.
I20260809 00:51:43.044466 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:35687
--webserver_interface=127.28.92.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab
--principal=kudu/127.28.92.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:36207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:44847,127.28.92.189:35303,127.28.92.188:35687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:51:43.071684 32354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 1
I20260809 00:51:43.072906 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.072427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55532)
0809 00:51:43.072637 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.072742 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 00:51:43.073902 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.073520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55538)
0809 00:51:43.073709 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.073791 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 00:51:43.074120 32354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.142401 32354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 2
I20260809 00:51:43.143559 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.143091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55554)
0809 00:51:43.143304 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.143394 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 00:51:43.144577 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.144260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55556)
0809 00:51:43.144380 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.144453 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 00:51:43.144804 32354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.165131 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } attempt: 5
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:51:43.179174 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.165906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42856)
0809 00:51:43.166119 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.166142 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.166290 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.166703 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.166708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.167130 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.167356 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.167367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.168412 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.168418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.169416 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.169431 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.170272 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.170279 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.170522 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.171181 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.171200 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.173587 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.176599 (+ 3012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.176606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.176611 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.177003 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.177397 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.177403 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.177408 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.177565 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.178141 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.178146 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.178314 (+ 168us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.178450 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.178782 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 00:51:43.179163 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.165985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42856 (local address 127.28.92.189:35303)
0809 00:51:43.166169 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.166175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.166206 (+ 31us) server_negotiation.cc:407] Connection header received
0809 00:51:43.166441 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.166447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.166546 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.166642 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.167536 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.168264 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.169573 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.170117 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.170262 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.173802 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.173811 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.173817 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.173855 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.176464 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.177124 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.177130 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.177134 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.177282 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.177699 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.177705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.177708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.178012 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.178162 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.178573 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.178797 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 00:51:43.180387 32235 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:43.181452 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.181073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55568)
0809 00:51:43.181230 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.181310 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 00:51:43.182395 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.182061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55570)
0809 00:51:43.182222 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.182293 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 00:51:43.182612 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.233856 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 1
I20260809 00:51:43.235013 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.234543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55586)
0809 00:51:43.234752 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.234842 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 00:51:43.236011 32354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 3
I20260809 00:51:43.236143 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.235776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55594)
0809 00:51:43.235928 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.236015 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 00:51:43.236362 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.237143 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.236736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55606)
0809 00:51:43.236915 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.237007 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 00:51:43.238152 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.237750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55614)
0809 00:51:43.237965 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.238038 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
W20260809 00:51:43.238350 32354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.304637 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 2
I20260809 00:51:43.305951 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.305385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55628)
0809 00:51:43.305633 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.305768 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 00:51:43.307025 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.306678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55640)
0809 00:51:43.306827 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.306910 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 00:51:43.307242 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
W20260809 00:51:43.378873 32370 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 00:51:43.379186 32370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:43.379258 32370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:43.379339 32370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 00:51:43.381532 32354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 4
I20260809 00:51:43.382716 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.382206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55650)
0809 00:51:43.382419 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.382535 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 00:51:43.383601 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.383318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55658)
0809 00:51:43.383433 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.383499 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 00:51:43.383850 32354 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
W20260809 00:51:43.387404 32370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:43.387501 32370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:43.387601 32370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:43.387677 32370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:43.387753 32370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:43.398392 32370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:36207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:44847,127.28.92.189:35303,127.28.92.188:35687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab
--principal=kudu/127.28.92.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:35687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.92.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:43.399672 32370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:43.400933 32370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:43.411988 32376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:43.412125 32377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:43.412494 32379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:43.413019 32370 server_base.cc:1034] running on GCE node
I20260809 00:51:43.413441 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 3
I20260809 00:51:43.413869 32370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:43.414592 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.414113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55670)
0809 00:51:43.414299 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.414382 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 00:51:43.415639 32370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:43.415683 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.415263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55676)
0809 00:51:43.415436 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.415543 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260809 00:51:43.415993 32235 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:35687: Network error: Client connection negotiation failed: client connection to 127.28.92.188:35687: connect: Connection refused (error 111)
I20260809 00:51:43.416885 32370 hybrid_clock.cc:648] HybridClock initialized: now 1786236703416785 us; error 55 us; skew 500 ppm
I20260809 00:51:43.417263 32370 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236703, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:43.420806 32370 init.cc:377] Logged in from keytab as kudu/127.28.92.188@KRBTEST.COM (short username kudu)
I20260809 00:51:43.422394 32370 webserver.cc:460] Webserver started at http://127.28.92.188:33093/ using document root <none> and password file <none>
I20260809 00:51:43.423066 32370 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:43.423192 32370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:43.423494 32370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:43.426652 32370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data/instance:
uuid: "46394a24745f49d59ec6c9cf0bc5084b"
format_stamp: "Formatted at 2026-08-09 00:51:43 on dist-test-slave-t7g5"
server_key: "421cbce19b438cc02596ca974e9a3586"
server_key_iv: "b9e1c0b858a1df69f4247f6dc0a46b12"
server_key_version: "encryptionkey@0"
I20260809 00:51:43.427536 32370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal/instance:
uuid: "46394a24745f49d59ec6c9cf0bc5084b"
format_stamp: "Formatted at 2026-08-09 00:51:43 on dist-test-slave-t7g5"
server_key: "421cbce19b438cc02596ca974e9a3586"
server_key_iv: "b9e1c0b858a1df69f4247f6dc0a46b12"
server_key_version: "encryptionkey@0"
I20260809 00:51:43.432662 32370 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260809 00:51:43.436414 32390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:43.437814 32370 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:43.438000 32370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal
uuid: "46394a24745f49d59ec6c9cf0bc5084b"
format_stamp: "Formatted at 2026-08-09 00:51:43 on dist-test-slave-t7g5"
server_key: "421cbce19b438cc02596ca974e9a3586"
server_key_iv: "b9e1c0b858a1df69f4247f6dc0a46b12"
server_key_version: "encryptionkey@0"
I20260809 00:51:43.438197 32370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:43.451750 32370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:43.456086 32370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:43.456342 32370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:43.473783 32370 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.188:35687
I20260809 00:51:43.473805 32477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.188:35687 every 8 connection(s)
I20260809 00:51:43.475221 32370 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
I20260809 00:51:43.478983 32479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:43.484517 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 32370
I20260809 00:51:43.484694 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786236336094448-29042-0/minicluster-data/master-2/wal/instance
I20260809 00:51:43.485113 29042 external_mini_cluster.cc:1428] Setting key 683696cbb169a6ea0fbce0bd64b01fac
I20260809 00:51:43.485581 32479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236703, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:51:43.504179 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.488531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51794 (local address 127.28.92.190:44847)
0809 00:51:43.488739 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.488744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.489374 (+ 630us) server_negotiation.cc:407] Connection header received
0809 00:51:43.490165 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.490169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.490234 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.490313 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.491669 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.492386 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.494101 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.494668 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.494758 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.498345 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.498350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.498353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.498395 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.501067 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.501892 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.501896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.501899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.502035 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.502437 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.502441 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.502443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.502705 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.502856 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.503577 (+ 721us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.503822 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:51:43.505216 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.488456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:44847 (local address 127.0.0.1:51794)
0809 00:51:43.489207 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.489254 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.489902 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.490411 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.490417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.491133 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.491500 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.491518 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.492551 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.492556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.493971 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.493983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.494877 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.494885 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.495157 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.495861 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.495885 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.498168 (+ 2283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.501189 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.501200 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.501213 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.501775 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.502138 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.502143 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.502147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.502324 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.502841 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.502849 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.503189 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.503446 (+ 257us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.503951 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":6,"thread_start_us":321,"threads_started":1}
I20260809 00:51:43.505234 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.486931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55680 (local address 127.28.92.188:35687)
0809 00:51:43.487651 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.487661 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.487699 (+ 38us) server_negotiation.cc:407] Connection header received
0809 00:51:43.489902 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.489932 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.490215 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.490395 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.491732 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.493142 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.494462 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.495138 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.495247 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.499142 (+ 3895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.499150 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.499163 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.499191 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.501917 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.502694 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.502700 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.502703 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.502831 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.503247 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.503251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.503253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.503617 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.503914 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.504359 (+ 445us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.504601 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":521,"thread_start_us":344,"threads_started":1}
I20260809 00:51:43.506983 32479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236703, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:43.520066 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.507843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:35303 (local address 127.0.0.1:42870)
0809 00:51:43.508003 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.508021 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.508115 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.508427 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.508432 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.508827 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.508986 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.508994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.510000 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.510005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.510873 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.510894 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.511592 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.511597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.511780 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.512314 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.512336 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.514522 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.517756 (+ 3234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.517761 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.517763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.518206 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.518627 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.518631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.518633 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.518774 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.519354 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.519357 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.519488 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.519593 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.519804 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 00:51:43.520275 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.507785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42870 (local address 127.28.92.189:35303)
0809 00:51:43.507962 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.507968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.508084 (+ 116us) server_negotiation.cc:407] Connection header received
0809 00:51:43.508208 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.508213 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.508282 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.508373 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.509136 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.509861 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.511022 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.511457 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.511569 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.514701 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.514707 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.514711 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.514745 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.517589 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.518323 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.518329 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.518332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.518502 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.518876 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.518881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.518884 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.519241 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.519418 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.519709 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.519926 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 00:51:43.521304 32479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:43.522855 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.508626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51808 (local address 127.28.92.190:44847)
0809 00:51:43.508797 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.508803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.508820 (+ 17us) server_negotiation.cc:407] Connection header received
0809 00:51:43.508863 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.508866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.508915 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.508998 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.510150 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.510868 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.512071 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.512647 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.512774 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.516899 (+ 4125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.516904 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.516908 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.516959 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.520044 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.520828 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.520833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.520837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.520992 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.521367 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.521370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.521372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.521746 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.522041 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.522331 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.522553 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236703, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:51:43.534267 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.522088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55690)
0809 00:51:43.522248 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.522266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.522360 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.522690 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.522846 (+ 156us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.523254 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.523388 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.523397 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.524490 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.524493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.525312 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.525321 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.526245 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.526249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.526540 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.527075 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.527097 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.529268 (+ 2171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.531903 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.531909 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.531913 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.532303 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.532703 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.532708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.532711 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.532872 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.533367 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.533372 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.533539 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.533708 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.533945 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":35}
I20260809 00:51:43.534464 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.522328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55690 (local address 127.28.92.188:35687)
0809 00:51:43.522483 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.522487 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.522499 (+ 12us) server_negotiation.cc:407] Connection header received
0809 00:51:43.522532 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.522535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.522583 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.522654 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.523517 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.524342 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.525444 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.526108 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.526248 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.529462 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.529467 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.529471 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.529499 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.531761 (+ 2262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.532419 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.532424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.532428 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.532591 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.532984 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.532988 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.532990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.533253 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.533358 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.533809 (+ 451us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.534125 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":54}
I20260809 00:51:43.539558 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.524364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42878 (local address 127.28.92.189:35303)
0809 00:51:43.524504 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.524508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.524653 (+ 145us) server_negotiation.cc:407] Connection header received
0809 00:51:43.524784 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.524789 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.524852 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.524939 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.526381 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.527374 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.528723 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.529190 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.529284 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.533518 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.533523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.533526 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.533558 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.537073 (+ 3515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.537705 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.537711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.537714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.537870 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.538235 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.538241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.538244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.538574 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.538814 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.539028 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.539242 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 00:51:43.540323 32479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: Bootstrap starting.
I20260809 00:51:43.543990 32479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:43.544261 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:43.545262 32479 log.cc:824] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:43.548260 32479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: No bootstrap required, opened a new log
I20260809 00:51:43.547536 32196 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3a53323a5ad0452cb915fcac1227998e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51808
I20260809 00:51:43.558869 32479 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.559260 32479 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46394a24745f49d59ec6c9cf0bc5084b, State: Initialized, Role: FOLLOWER
I20260809 00:51:43.559758 32479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.560649 32487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.560971 32487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.561920 32479 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: configured and running, proceeding with master startup.
W20260809 00:51:43.570972 32506 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:51:43.571151 32506 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:51:43.568631 32370 master_runner.cc:186] Error getting master registration for 127.28.92.190:44847: OK, instance_id { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" instance_seqno: 1786236702445411 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 00:51:43.579502 32370 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 00:51:43.593199 32235 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 4
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:51:43.607949 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.593873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:55696)
0809 00:51:43.594164 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.594180 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.594290 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.594633 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.594637 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.595019 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.595182 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.595192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.596614 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.596617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.597560 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.597572 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.598534 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.598539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.598688 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.599254 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.599272 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.601491 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.605387 (+ 3896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.605393 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.605397 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.605915 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.606321 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.606325 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.606329 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.606506 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.607239 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.607243 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.607375 (+ 132us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.607493 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.607681 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172}
I20260809 00:51:43.608321 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.593963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55696 (local address 127.28.92.188:35687)
0809 00:51:43.594165 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.594172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.594236 (+ 64us) server_negotiation.cc:407] Connection header received
0809 00:51:43.594408 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.594413 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.594492 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.594621 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.595320 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.596485 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.597703 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.598403 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.598531 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.601706 (+ 3175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.601713 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.601719 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.601758 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.605256 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.606038 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.606044 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.606048 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.606196 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.606625 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.606630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.606633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.607090 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.607262 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.607607 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.607830 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 00:51:43.612828 32235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: Bootstrap starting.
I20260809 00:51:43.616171 32235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:43.617223 32235 log.cc:824] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:43.619891 32235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: No bootstrap required, opened a new log
I20260809 00:51:43.624951 32235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.625269 32235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a53323a5ad0452cb915fcac1227998e, State: Initialized, Role: FOLLOWER
I20260809 00:51:43.625741 32235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.626662 32509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.627077 32509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.627789 32235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:43.628062 32196 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 00:51:43.628316 32196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:43.632129 32196 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.636127 32430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a53323a5ad0452cb915fcac1227998e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "46394a24745f49d59ec6c9cf0bc5084b"
I20260809 00:51:43.636639 32196 leader_election.cc:288] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [CANDIDATE]: Term 1 election: Requested vote from peers 90f96016fe964a07a9ec244a3f051d76 (127.28.92.189:35303), 46394a24745f49d59ec6c9cf0bc5084b (127.28.92.188:35687)
I20260809 00:51:43.636689 32430 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:43.640213 32430 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a53323a5ad0452cb915fcac1227998e in term 1.
W20260809 00:51:43.640250 32529 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:51:43.640552 32529 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:51:43.641202 32158 leader_election.cc:302] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a53323a5ad0452cb915fcac1227998e, 46394a24745f49d59ec6c9cf0bc5084b; no voters:
I20260809 00:51:43.641708 32509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:43.642217 32129 master_runner.cc:186] Error getting master registration for 127.28.92.189:35303: OK, instance_id { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" instance_seqno: 1786236702959701 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 00:51:43.653898 32129 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 00:51:43.654281 32509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [term 1 LEADER]: Becoming Leader. State: Replica: 3a53323a5ad0452cb915fcac1227998e, State: Running, Role: LEADER
I20260809 00:51:43.654937 32509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.658574 32534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a53323a5ad0452cb915fcac1227998e. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.659015 32534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:43.660059 32539 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:43.662580 32539 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 00:51:43.674110 32430 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [term 1 FOLLOWER]: Refusing update from remote peer 3a53323a5ad0452cb915fcac1227998e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:51:43.675416 32534 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [LEADER]: Connected to new peer: Peer: permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:51:43.683065 32354 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } attempt: 5
W20260809 00:51:43.685866 32163 tablet.cc:2369] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 00:51:43 dist-test-slave-t7g5 krb5kdc[32111](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236702, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
W20260809 00:51:43.709168 32399 tablet.cc:2369] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:51:43.712809 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.683629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:35687 (local address 127.0.0.1:45294)
0809 00:51:43.683975 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:43.683993 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:43.684110 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:43.690545 (+ 6435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:43.690550 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:43.691094 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:43.691311 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.691324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.694054 (+ 2730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.694060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.695436 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:43.695455 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.700660 (+ 5205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.700666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:43.700923 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.701638 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:43.701681 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:43.704741 (+ 3060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:43.709221 (+ 4480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.709226 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.709229 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.709756 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.710297 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:43.710302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:43.710305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:43.710483 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:43.711811 (+ 1328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:43.711816 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:43.711953 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 00:51:43.712090 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 00:51:43.712378 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215}
I20260809 00:51:43.713249 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.672820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35942 (local address 127.28.92.189:35303)
0809 00:51:43.673008 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.673014 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.688884 (+ 15870us) server_negotiation.cc:407] Connection header received
0809 00:51:43.691576 (+ 2692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.691581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.691653 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.691720 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.695155 (+ 3435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.696245 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.700826 (+ 4581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.701451 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.701548 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.705267 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.705274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.705278 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.705312 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.708716 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.710762 (+ 2046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.710767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.710770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.710907 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.711388 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.711393 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.711396 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.711763 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.711995 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.712604 (+ 609us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.712833 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 00:51:43.714260 32550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.683942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45294 (local address 127.28.92.188:35687)
0809 00:51:43.690182 (+ 6240us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.690187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.690210 (+ 23us) server_negotiation.cc:407] Connection header received
0809 00:51:43.690264 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.690269 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.690345 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.691477 (+ 1132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.691768 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.693875 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.695659 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.700476 (+ 4817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.704929 (+ 4453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.705207 (+ 278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.705214 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.705219 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.705258 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.709060 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.709911 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.709916 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.709919 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.710158 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.710634 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.710638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.710641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.711016 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.713477 (+ 2461us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.713613 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.713845 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6092,"thread_start_us":5920,"threads_started":1}
I20260809 00:51:43.719350 32354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: Bootstrap starting.
I20260809 00:51:43.723635 32354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:43.725101 32354 log.cc:824] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:43.727419 32487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a53323a5ad0452cb915fcac1227998e. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.727790 32487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.730810 32354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: No bootstrap required, opened a new log
I20260809 00:51:43.739038 32541 mvcc.cc:205] Tried to move back new op lower bound from 7316425538234134528 to 7316425538176118784. Current Snapshot: MvccSnapshot[applied={T|T < 7316425538234134528}]
I20260809 00:51:43.749625 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.679088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55260 (local address 127.28.92.190:44847)
0809 00:51:43.679249 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.679255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.703441 (+ 24186us) server_negotiation.cc:407] Connection header received
0809 00:51:43.706401 (+ 2960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.706408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.706495 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.706564 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.721049 (+ 14485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.722300 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.726986 (+ 4686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.727672 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.727775 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.742792 (+ 15017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.742800 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.742806 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.742857 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.746685 (+ 3828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.747436 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.747442 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.747445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.747623 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.748009 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.748013 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.748016 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.748405 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.748675 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.748991 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.749225 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 00:51:43.752107 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:43.672441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45278 (local address 127.28.92.188:35687)
0809 00:51:43.672626 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.672632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:43.689442 (+ 16810us) server_negotiation.cc:407] Connection header received
0809 00:51:43.690562 (+ 1120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:43.690567 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:43.690629 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:43.690692 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:43.697789 (+ 7097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.698869 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.704807 (+ 5938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:43.705556 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:43.705669 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:43.730563 (+ 24894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:43.730570 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:43.730575 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:43.730617 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:43.734327 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.735241 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.735247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.735251 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.735401 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:43.735890 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:43.735896 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:43.735899 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:43.736272 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:43.736533 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:43.751479 (+ 14946us) server_negotiation.cc:299] Negotiation successful
0809 00:51:43.751740 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:51:43.757562 32487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.757882 32487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.754050 32509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.759454 32509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:43.760061 32354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.760504 32354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90f96016fe964a07a9ec244a3f051d76, State: Initialized, Role: FOLLOWER
I20260809 00:51:43.761036 32354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } }
I20260809 00:51:43.765931 32539 catalog_manager.cc:1347] Generated new cluster ID: ac42b30a333045dba9a7cd1bc01a5e01
I20260809 00:51:43.766039 32539 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:43.768049 32559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.768386 32559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.770005 32354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:43.770064 32308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3a53323a5ad0452cb915fcac1227998e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "90f96016fe964a07a9ec244a3f051d76"
I20260809 00:51:43.770532 32308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:43.774042 32308 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a53323a5ad0452cb915fcac1227998e in term 1.
I20260809 00:51:43.774832 32307 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [term 1 FOLLOWER]: Refusing update from remote peer 3a53323a5ad0452cb915fcac1227998e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:51:43.775835 32509 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [LEADER]: Connected to new peer: Peer: permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:51:43.817740 32559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a53323a5ad0452cb915fcac1227998e. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.818074 32559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.818403 32568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.818831 32568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:43.821074 32509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3a53323a5ad0452cb915fcac1227998e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a53323a5ad0452cb915fcac1227998e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 44847 } } peers { permanent_uuid: "90f96016fe964a07a9ec244a3f051d76" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 35303 } } peers { permanent_uuid: "46394a24745f49d59ec6c9cf0bc5084b" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 35687 } } }
I20260809 00:51:43.821372 32509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:43.833168 32539 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:43.838150 32539 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:43.859853 32539 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a53323a5ad0452cb915fcac1227998e: Generated new TSK 0
I20260809 00:51:43.863020 32539 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:43.867504 32576 catalog_manager.cc:1259] Loaded cluster ID: ac42b30a333045dba9a7cd1bc01a5e01
I20260809 00:51:43.867606 32576 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: loading cluster ID for follower catalog manager: success
I20260809 00:51:43.871043 32576 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: acquiring CA information for follower catalog manager: success
I20260809 00:51:43.873318 32576 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 90f96016fe964a07a9ec244a3f051d76: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 00:51:44.008893 32366 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:43.983163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35946 (local address 127.28.92.189:35303)
0809 00:51:43.983421 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.983428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.004734 (+ 21306us) server_negotiation.cc:407] Connection header received
0809 00:51:44.007170 (+ 2436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.007177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.007294 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.007399 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.008634 (+ 1235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35946: BlockingRecv error: recv got EOF from 127.0.0.1:35946 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 00:51:44.011272 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:43.989407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45296 (local address 127.28.92.188:35687)
0809 00:51:43.989575 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:43.989581 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.006848 (+ 17267us) server_negotiation.cc:407] Connection header received
0809 00:51:44.009574 (+ 2726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.009581 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.009705 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.009782 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.010972 (+ 1190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45296: BlockingRecv error: recv got EOF from 127.0.0.1:45296 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 00:51:44.014441 32238 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.000129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55276 (local address 127.28.92.190:44847)
0809 00:51:44.000340 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.000347 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.012088 (+ 11741us) server_negotiation.cc:407] Connection header received
0809 00:51:44.012754 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.012760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.012863 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.012937 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.014172 (+ 1235us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55276: BlockingRecv error: recv got EOF from 127.0.0.1:55276 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:51:44.075176 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.056143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35948 (local address 127.28.92.189:35303)
0809 00:51:44.056371 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.056378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.066870 (+ 10492us) server_negotiation.cc:407] Connection header received
0809 00:51:44.067486 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.067493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.067720 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.067876 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.068717 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.069899 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.071960 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.072652 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.072754 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.073538 (+ 784us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.074290 (+ 752us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.074430 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.074688 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.074799 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 00:51:44.119740 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.110015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.28.92.188:35687)
0809 00:51:44.110256 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.110263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.117323 (+ 7060us) server_negotiation.cc:407] Connection header received
0809 00:51:44.117996 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.118003 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.118169 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.118256 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.119492 (+ 1236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45310: BlockingRecv error: recv got EOF from 127.0.0.1:45310 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 00:51:44.173488 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.155427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35962 (local address 127.28.92.189:35303)
0809 00:51:44.155645 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.155652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.166295 (+ 10643us) server_negotiation.cc:407] Connection header received
0809 00:51:44.166892 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.166899 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.167025 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.167105 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.167860 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.169051 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.171083 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.171743 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.171858 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.172510 (+ 652us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.172705 (+ 195us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.172782 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.173025 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.173120 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
W20260809 00:51:44.223040 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.212198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45312 (local address 127.28.92.188:35687)
0809 00:51:44.212403 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.212409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.220764 (+ 8355us) server_negotiation.cc:407] Connection header received
0809 00:51:44.221543 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.221549 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.221681 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.221759 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.222808 (+ 1049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45312: BlockingRecv error: recv got EOF from 127.0.0.1:45312 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:51:44.243722 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.236948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35978 (local address 127.28.92.189:35303)
0809 00:51:44.237122 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.237129 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.237311 (+ 182us) server_negotiation.cc:407] Connection header received
0809 00:51:44.237407 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.237413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.237498 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.237616 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.238160 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.239319 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.241349 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.242080 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.242175 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.242870 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.243018 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.243080 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.243296 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.243400 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 00:51:44.254429 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.251761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.28.92.188:35687)
0809 00:51:44.251929 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.251935 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.252463 (+ 528us) server_negotiation.cc:407] Connection header received
0809 00:51:44.252640 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.252647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.252741 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.252843 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.254197 (+ 1354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45318: BlockingRecv error: recv got EOF from 127.0.0.1:45318 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 00:51:44.267006 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.261074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35990 (local address 127.28.92.189:35303)
0809 00:51:44.261331 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.261336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.261578 (+ 242us) server_negotiation.cc:407] Connection header received
0809 00:51:44.261753 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.261758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.261849 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.261986 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.262403 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.263599 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.265019 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.265801 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.265965 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.266314 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.266447 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.266545 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.266625 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.266706 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
W20260809 00:51:44.276892 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.274990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45334 (local address 127.28.92.188:35687)
0809 00:51:44.275250 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.275256 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.275504 (+ 248us) server_negotiation.cc:407] Connection header received
0809 00:51:44.275701 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.275705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.275776 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.275859 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.276641 (+ 782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45334: BlockingRecv error: recv got EOF from 127.0.0.1:45334 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
I20260809 00:51:44.294447 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.288597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36006 (local address 127.28.92.189:35303)
0809 00:51:44.288815 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.288826 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.289087 (+ 261us) server_negotiation.cc:407] Connection header received
0809 00:51:44.289277 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.289283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.289382 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.289504 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.289912 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.291037 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.292367 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.293057 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.293187 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.293563 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.293735 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.293828 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.293952 (+ 124us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.294034 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260809 00:51:44.303606 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.301227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45350 (local address 127.28.92.188:35687)
0809 00:51:44.301415 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.301421 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.302056 (+ 635us) server_negotiation.cc:407] Connection header received
0809 00:51:44.302234 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.302240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.302317 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.302408 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.303387 (+ 979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45350: BlockingRecv error: recv got EOF from 127.0.0.1:45350 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:51:44.328848 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.323157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36012 (local address 127.28.92.189:35303)
0809 00:51:44.323358 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.323364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.323647 (+ 283us) server_negotiation.cc:407] Connection header received
0809 00:51:44.323814 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.323821 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.323926 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.324072 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.324427 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.325694 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.326964 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.327621 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.327750 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.328147 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.328284 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.328375 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.328468 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.328560 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260809 00:51:44.337883 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.335771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45356 (local address 127.28.92.188:35687)
0809 00:51:44.335988 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.335994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.336493 (+ 499us) server_negotiation.cc:407] Connection header received
0809 00:51:44.336668 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.336671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.336742 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.336821 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.337618 (+ 797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45356: BlockingRecv error: recv got EOF from 127.0.0.1:45356 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:51:44.378940 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.373304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36028 (local address 127.28.92.189:35303)
0809 00:51:44.373498 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.373504 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.373839 (+ 335us) server_negotiation.cc:407] Connection header received
0809 00:51:44.374024 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.374029 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.374122 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.374250 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.374608 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.375730 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.377009 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.377687 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.377819 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.378178 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.378317 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.378442 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.378528 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.378616 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260809 00:51:44.388804 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.387028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45364 (local address 127.28.92.188:35687)
0809 00:51:44.387264 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.387269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.387522 (+ 253us) server_negotiation.cc:407] Connection header received
0809 00:51:44.387700 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.387705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.387777 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.387863 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.388615 (+ 752us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45364: BlockingRecv error: recv got EOF from 127.0.0.1:45364 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 00:51:44.462229 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.456509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36036 (local address 127.28.92.189:35303)
0809 00:51:44.456715 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.456721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.457060 (+ 339us) server_negotiation.cc:407] Connection header received
0809 00:51:44.457259 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.457263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.457351 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.457439 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.457901 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.458610 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.460533 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.460928 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.461019 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.461475 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.461579 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.461637 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.461840 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.461931 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260809 00:51:44.470958 32483 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:44.468964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.28.92.188:35687)
0809 00:51:44.469159 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.469165 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.469611 (+ 446us) server_negotiation.cc:407] Connection header received
0809 00:51:44.469799 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.469803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.469874 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.469962 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:44.470718 (+ 756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45378: BlockingRecv error: recv got EOF from 127.0.0.1:45378 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 00:51:44.573139 32506 catalog_manager.cc:1259] Loaded cluster ID: ac42b30a333045dba9a7cd1bc01a5e01
I20260809 00:51:44.573243 32506 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: loading cluster ID for follower catalog manager: success
I20260809 00:51:44.575783 32506 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: acquiring CA information for follower catalog manager: success
I20260809 00:51:44.577533 32506 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 46394a24745f49d59ec6c9cf0bc5084b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 00:51:44.607184 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.602506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36044 (local address 127.28.92.189:35303)
0809 00:51:44.602698 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.602703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.602990 (+ 287us) server_negotiation.cc:407] Connection header received
0809 00:51:44.603154 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.603158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.603235 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.603342 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.603695 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.604402 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.605737 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.606171 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.606275 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.606611 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.606714 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.606799 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.606891 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.606961 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 00:51:44.618706 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.613015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45386 (local address 127.28.92.188:35687)
0809 00:51:44.613252 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.613258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.613478 (+ 220us) server_negotiation.cc:407] Connection header received
0809 00:51:44.613637 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.613641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.613845 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.613956 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.614316 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.615035 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.616466 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.616915 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.617037 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.617508 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.618156 (+ 648us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.618265 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.618363 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.618439 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 00:51:44.633462 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.625683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45400 (local address 127.28.92.188:35687)
0809 00:51:44.625894 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.625901 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.627602 (+ 1701us) server_negotiation.cc:407] Connection header received
0809 00:51:44.627725 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.627731 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.627826 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.627917 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.628860 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.629989 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.631619 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.632137 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.632245 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.632666 (+ 421us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.632799 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.632899 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.633071 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.633156 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:51:44.634595 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.625145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55290 (local address 127.28.92.190:44847)
0809 00:51:44.626418 (+ 1273us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.626424 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.628242 (+ 1818us) server_negotiation.cc:407] Connection header received
0809 00:51:44.628516 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.628522 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.628755 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.628945 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.629422 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.630352 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.631957 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.632561 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.632675 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.633327 (+ 652us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.633812 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.633941 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.634063 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.634144 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1159,"thread_start_us":1056,"threads_started":1}
I20260809 00:51:44.635324 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:44.625473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36046 (local address 127.28.92.189:35303)
0809 00:51:44.626064 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:44.626070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:44.627377 (+ 1307us) server_negotiation.cc:407] Connection header received
0809 00:51:44.627718 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:44.627724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:44.627821 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:44.627903 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:44.628813 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.629997 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.633416 (+ 3419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:44.634023 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:44.634140 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:44.634640 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:44.634766 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:44.634861 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:44.635005 (+ 144us) server_negotiation.cc:299] Negotiation successful
0809 00:51:44.635089 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453}
I20260809 00:51:44.643572 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32129
I20260809 00:51:44.644526 32225 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:44.753931 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 32129
W20260809 00:51:44.782229 32392 connection.cc:535] server connection from 127.0.0.1:55696 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 00:51:44.782850 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32243
I20260809 00:51:44.783960 32346 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:44.889745 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 32243
I20260809 00:51:44.915810 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 32370
I20260809 00:51:44.917028 32467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:45.028715 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 32370
2026-08-09T00:51:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4610 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 00:51:45 dist-test-slave-t7g5 krb5kdc[311](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 00:51:45 dist-test-slave-t7g5 krb5kdc[311](info): set up 2 sockets
Aug 09 00:51:45 dist-test-slave-t7g5 krb5kdc[311](info): commencing operation
krb5kdc: starting...
W20260809 00:51:46.281730 29042 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.006s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/test-user.keytab.
Aug 09 00:51:46 dist-test-slave-t7g5 krb5kdc[311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T00:51:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T00:51:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.28.92.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
Entry for principal kudu/127.28.92.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab.
I20260809 00:51:46.601967 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33387
--webserver_interface=127.28.92.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:33387,127.28.92.189:39303,127.28.92.188:39399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 00:51:46.949856 337 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 00:51:46.950253 337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:46.950371 337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:46.950498 337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:46.958096 337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:46.958204 337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:46.958289 337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:46.958374 337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:46.958475 337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:46.968760 337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:33387,127.28.92.189:39303,127.28.92.188:39399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.190.keytab
--principal=kudu/127.28.92.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.190:33387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.28.92.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:46.970185 337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:46.971873 337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:46.983889 350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:46.983973 345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:46.983937 347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:46.984863 337 server_base.cc:1034] running on GCE node
I20260809 00:51:46.985754 337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:46.987133 337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:46.988366 337 hybrid_clock.cc:648] HybridClock initialized: now 1786236706988298 us; error 43 us; skew 500 ppm
I20260809 00:51:46.988679 337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:46 dist-test-slave-t7g5 krb5kdc[311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:46.995463 337 init.cc:377] Logged in from keytab as kudu/127.28.92.190@KRBTEST.COM (short username kudu)
I20260809 00:51:46.996905 337 webserver.cc:460] Webserver started at http://127.28.92.190:36037/ using document root <none> and password file <none>
I20260809 00:51:46.997560 337 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:46.997671 337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:46.997990 337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:47.000963 337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data/instance:
uuid: "75f3448b89234aa3ad5a1976c42f2a5e"
format_stamp: "Formatted at 2026-08-09 00:51:46 on dist-test-slave-t7g5"
server_key: "9d08d0c31187e0e85ab159720d23822c"
server_key_iv: "09c66000077ff179e1ccf684dd6d614d"
server_key_version: "encryptionkey@0"
I20260809 00:51:47.001762 337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal/instance:
uuid: "75f3448b89234aa3ad5a1976c42f2a5e"
format_stamp: "Formatted at 2026-08-09 00:51:46 on dist-test-slave-t7g5"
server_key: "9d08d0c31187e0e85ab159720d23822c"
server_key_iv: "09c66000077ff179e1ccf684dd6d614d"
server_key_version: "encryptionkey@0"
I20260809 00:51:47.006861 337 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260809 00:51:47.010401 359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:47.011711 337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 00:51:47.011870 337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal
uuid: "75f3448b89234aa3ad5a1976c42f2a5e"
format_stamp: "Formatted at 2026-08-09 00:51:46 on dist-test-slave-t7g5"
server_key: "9d08d0c31187e0e85ab159720d23822c"
server_key_iv: "09c66000077ff179e1ccf684dd6d614d"
server_key_version: "encryptionkey@0"
I20260809 00:51:47.012084 337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:47.030071 337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:47.034327 337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:47.034600 337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:47.053114 337 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.190:33387
I20260809 00:51:47.053124 434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.190:33387 every 8 connection(s)
I20260809 00:51:47.054557 337 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/data/info.pb
I20260809 00:51:47.058373 436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:47.062069 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 337
I20260809 00:51:47.062284 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-0/wal/instance
I20260809 00:51:47.062832 29042 external_mini_cluster.cc:1428] Setting key b722fae93badcac2709b73582709a806
I20260809 00:51:47.066277 436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:47 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:47.089311 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.069813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:33387 (local address 127.0.0.1:54860)
0809 00:51:47.070634 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.070688 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:47.072590 (+ 1902us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:47.073392 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:47.073398 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:47.074111 (+ 713us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:47.074442 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.074461 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.076011 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.076015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.077068 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.077082 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.078279 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.078285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.078426 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.079052 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:47.079076 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:47.081283 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:47.085159 (+ 3876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.085170 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.085180 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.085580 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.086107 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.086111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.086113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.086278 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.087240 (+ 962us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:47.087248 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:47.087470 (+ 222us) client_negotiation.cc:769] Sending connection context
0809 00:51:47.087723 (+ 253us) client_negotiation.cc:240] Negotiation successful
0809 00:51:47.088144 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":335,"threads_started":1}
I20260809 00:51:47.089350 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.069813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54860 (local address 127.28.92.190:33387)
0809 00:51:47.071386 (+ 1573us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:47.071394 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:47.071457 (+ 63us) server_negotiation.cc:407] Connection header received
0809 00:51:47.072941 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:47.072946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:47.073169 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:47.073340 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:47.074646 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.075860 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.077204 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.078032 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.078202 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.081547 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:47.081558 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:47.081573 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:47.081606 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:47.085020 (+ 3414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.085739 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.085749 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.085752 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.085981 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.086382 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.086386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.086389 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.087037 (+ 648us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:47.087231 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:47.087872 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 00:51:47.088314 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":153,"server-negotiator.queue_time_us":1367,"thread_start_us":1165,"threads_started":1}
I20260809 00:51:47.092494 436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:47.093729 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.093303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:45966)
0809 00:51:47.093472 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.093581 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260809 00:51:47.094022 362 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
I20260809 00:51:47.095538 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.095190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:45970)
0809 00:51:47.095332 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.095403 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 00:51:47.095726 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:39303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.28.92.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab.
Entry for principal kudu/127.28.92.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab.
I20260809 00:51:47.134567 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:39303
--webserver_interface=127.28.92.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab
--principal=kudu/127.28.92.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:33387,127.28.92.189:39303,127.28.92.188:39399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:51:47.145092 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } attempt: 1
I20260809 00:51:47.146353 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.145891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:45976)
0809 00:51:47.146094 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.146211 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 00:51:47.147513 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.147075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:45984)
0809 00:51:47.147235 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.147329 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 00:51:47.147747 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:39303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
I20260809 00:51:47.215977 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } attempt: 2
I20260809 00:51:47.217248 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.216723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:45990)
0809 00:51:47.216991 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.217099 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 00:51:47.218492 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.218114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46006)
0809 00:51:47.218244 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.218347 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 00:51:47.218716 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:39303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
I20260809 00:51:47.309995 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } attempt: 3
I20260809 00:51:47.311205 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.310767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46012)
0809 00:51:47.310967 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.311064 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260809 00:51:47.312291 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.311928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46022)
0809 00:51:47.312065 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.312140 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 00:51:47.312500 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:39303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
I20260809 00:51:47.455737 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } attempt: 4
I20260809 00:51:47.456971 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.456436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46032)
0809 00:51:47.456742 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.456830 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260809 00:51:47.457933 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.457574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46038)
0809 00:51:47.457736 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.457807 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 00:51:47.458108 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.189:39303: Network error: Client connection negotiation failed: client connection to 127.28.92.189:39303: connect: Connection refused (error 111)
W20260809 00:51:47.471686 448 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 00:51:47.472002 448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:47.472097 448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:47.472208 448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 00:51:47.479224 448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:47.479314 448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:47.479408 448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:47.479475 448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:47.479558 448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:47.488893 448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:33387,127.28.92.189:39303,127.28.92.188:39399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.189.keytab
--principal=kudu/127.28.92.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.189:39303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.28.92.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:47.490149 448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:47.491401 448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 00:51:47.502810 453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:47.502731 458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:47.502771 455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:47.503430 448 server_base.cc:1034] running on GCE node
I20260809 00:51:47.504240 448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:47.505645 448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:47.506908 448 hybrid_clock.cc:648] HybridClock initialized: now 1786236707506846 us; error 34 us; skew 500 ppm
I20260809 00:51:47.507198 448 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:47 dist-test-slave-t7g5 krb5kdc[311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:47.510350 448 init.cc:377] Logged in from keytab as kudu/127.28.92.189@KRBTEST.COM (short username kudu)
I20260809 00:51:47.511787 448 webserver.cc:460] Webserver started at http://127.28.92.189:42361/ using document root <none> and password file <none>
I20260809 00:51:47.512463 448 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:47.512565 448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:47.512879 448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:47.516043 448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data/instance:
uuid: "596912e50a994107b82dc51cf368a45b"
format_stamp: "Formatted at 2026-08-09 00:51:47 on dist-test-slave-t7g5"
server_key: "1719c27ce5046f50b635ef020845bdc6"
server_key_iv: "2d72cc995f1ab8d27361db47cca30245"
server_key_version: "encryptionkey@0"
I20260809 00:51:47.516875 448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal/instance:
uuid: "596912e50a994107b82dc51cf368a45b"
format_stamp: "Formatted at 2026-08-09 00:51:47 on dist-test-slave-t7g5"
server_key: "1719c27ce5046f50b635ef020845bdc6"
server_key_iv: "2d72cc995f1ab8d27361db47cca30245"
server_key_version: "encryptionkey@0"
I20260809 00:51:47.522058 448 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 00:51:47.525447 470 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:47.526760 448 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 00:51:47.526923 448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal
uuid: "596912e50a994107b82dc51cf368a45b"
format_stamp: "Formatted at 2026-08-09 00:51:47 on dist-test-slave-t7g5"
server_key: "1719c27ce5046f50b635ef020845bdc6"
server_key_iv: "2d72cc995f1ab8d27361db47cca30245"
server_key_version: "encryptionkey@0"
I20260809 00:51:47.527127 448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:47.539340 448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:47.543107 448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:47.543342 448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:47.560739 448 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.189:39303
I20260809 00:51:47.560761 545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.189:39303 every 8 connection(s)
I20260809 00:51:47.562134 448 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/data/info.pb
I20260809 00:51:47.565858 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 448
I20260809 00:51:47.565909 546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:47.566033 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-1/wal/instance
I20260809 00:51:47.566484 29042 external_mini_cluster.cc:1428] Setting key 3d33e856cf2e457a9c1fc528226f97ec
I20260809 00:51:47.572338 546 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:47 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:47.593111 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.574855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54866 (local address 127.28.92.190:33387)
0809 00:51:47.575075 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:47.575081 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:47.576315 (+ 1234us) server_negotiation.cc:407] Connection header received
0809 00:51:47.578273 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:47.578280 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:47.578359 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:47.578451 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:47.580245 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.580942 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.583028 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.583440 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.583533 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.587445 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:47.587450 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:47.587454 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:47.587488 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:47.590090 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.590945 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.590949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.590951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.591070 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.591473 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.591476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.591478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.591747 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:47.591859 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:47.592714 (+ 855us) server_negotiation.cc:299] Negotiation successful
0809 00:51:47.592888 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260809 00:51:47.594496 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.575356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:33387 (local address 127.0.0.1:54866)
0809 00:51:47.576147 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.576198 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:47.577996 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:47.578705 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:47.578715 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:47.579337 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:47.580037 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.580061 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.581108 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.581113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.582873 (+ 1760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.582889 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.583666 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.583673 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.583939 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.584619 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:47.584650 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:47.587208 (+ 2558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:47.590224 (+ 3016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.590232 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.590247 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.590844 (+ 597us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.591162 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.591166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.591169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.591383 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.591866 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:47.591873 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:47.592355 (+ 482us) client_negotiation.cc:769] Sending connection context
0809 00:51:47.592640 (+ 285us) client_negotiation.cc:240] Negotiation successful
0809 00:51:47.593129 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":302,"threads_started":1}
I20260809 00:51:47.596297 546 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.28.92.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.28.92.188@KRBTEST.COM" created.
Aug 09 00:51:47 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:51:47.610883 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.597104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46040)
0809 00:51:47.597296 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.597311 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:47.597392 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:47.598362 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:47.598367 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:47.598794 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:47.598937 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.598946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.600353 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.600357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.601274 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.601291 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.602216 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.602222 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.602401 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.602939 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:47.602962 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:47.605319 (+ 2357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:47.608355 (+ 3036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.608360 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.608363 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.608816 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.609183 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.609187 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.609190 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.609342 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.609957 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:47.609961 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:47.610116 (+ 155us) client_negotiation.cc:769] Sending connection context
0809 00:51:47.610260 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 00:51:47.610541 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 00:51:47.610972 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.597316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46040 (local address 127.28.92.189:39303)
0809 00:51:47.597988 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:47.597994 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:47.598019 (+ 25us) server_negotiation.cc:407] Connection header received
0809 00:51:47.598059 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:47.598064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:47.598223 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:47.598351 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:47.599103 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.600223 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.601418 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.602055 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.602155 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.605547 (+ 3392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:47.605560 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:47.605575 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:47.605610 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:47.608213 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.608948 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.608954 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.608957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.609075 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.609429 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.609431 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.609433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.609824 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:47.609992 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:47.610409 (+ 417us) server_negotiation.cc:299] Negotiation successful
0809 00:51:47.610650 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":527,"thread_start_us":399,"threads_started":1}
I20260809 00:51:47.613440 546 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:47.614691 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.614252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43540)
0809 00:51:47.614411 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.614525 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 00:51:47.614954 472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:47.616648 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.616265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43544)
0809 00:51:47.616439 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.616518 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 00:51:47.616873 546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.28.92.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab.
Entry for principal kudu/127.28.92.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab.
I20260809 00:51:47.638662 29042 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
/tmp/dist-test-tasksLdMAp/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:39399
--webserver_interface=127.28.92.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab
--principal=kudu/127.28.92.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.28.92.148:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.28.92.190:33387,127.28.92.189:39303,127.28.92.188:39399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 00:51:47.666222 546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 1
I20260809 00:51:47.667469 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.667002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43550)
0809 00:51:47.667194 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.667303 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 00:51:47.668499 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.668160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43552)
0809 00:51:47.668293 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.668390 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 00:51:47.668713 546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:47.736907 546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 2
I20260809 00:51:47.738034 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.737570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43558)
0809 00:51:47.737781 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.737875 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 00:51:47.738999 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.738683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43568)
0809 00:51:47.738813 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.738882 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 00:51:47.739235 546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:47.757323 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } attempt: 5
Aug 09 00:51:47 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:51:47.770234 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.758076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46044)
0809 00:51:47.758294 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.758315 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:47.758455 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:47.758810 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:47.758815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:47.759227 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:47.759413 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.759423 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.760381 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.760385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.761239 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:47.761252 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.762019 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.762024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:47.762233 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.762835 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:47.762852 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:47.765065 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:47.767897 (+ 2832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.767902 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.767907 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.768275 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.768633 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:47.768638 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:47.768642 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:47.768784 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:47.769280 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:47.769285 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:47.769435 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 00:51:47.769557 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 00:51:47.769858 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 00:51:47.770234 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.758108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46044 (local address 127.28.92.189:39303)
0809 00:51:47.758293 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:47.758299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:47.758401 (+ 102us) server_negotiation.cc:407] Connection header received
0809 00:51:47.758592 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:47.758596 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:47.758663 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:47.758751 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:47.759567 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.760245 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.761393 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:47.761872 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:47.761988 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:47.765247 (+ 3259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:47.765252 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:47.765255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:47.765288 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:47.767758 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.768396 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.768400 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.768402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.768527 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:47.768883 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:47.768887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:47.768889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:47.769167 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:47.769298 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:47.769712 (+ 414us) server_negotiation.cc:299] Negotiation successful
0809 00:51:47.769927 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 00:51:47.771556 436 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:47.772708 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.772336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43580)
0809 00:51:47.772501 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.772576 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 00:51:47.773553 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.773240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43588)
0809 00:51:47.773374 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.773442 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 00:51:47.773756 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:47.824983 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 1
I20260809 00:51:47.826089 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.825598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43596)
0809 00:51:47.825796 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.825917 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 00:51:47.827045 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.826709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43604)
0809 00:51:47.826856 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.826934 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 00:51:47.827252 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:47.830431 546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 3
I20260809 00:51:47.831413 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.830997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43618)
0809 00:51:47.831180 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.831266 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260809 00:51:47.832403 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.831997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43620)
0809 00:51:47.832208 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.832281 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
W20260809 00:51:47.832617 546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:47.895458 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 2
I20260809 00:51:47.896612 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.896129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43632)
0809 00:51:47.896328 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.896446 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 00:51:47.897578 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.897204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43646)
0809 00:51:47.897403 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.897474 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260809 00:51:47.897832 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
W20260809 00:51:47.974050 558 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 00:51:47.974409 558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 00:51:47.974516 558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 00:51:47.974639 558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 00:51:47.975826 546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 4
I20260809 00:51:47.976955 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.976440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43662)
0809 00:51:47.976690 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.976800 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 00:51:47.977981 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:47.977641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43678)
0809 00:51:47.977795 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:47.977871 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 00:51:47.978206 546 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
W20260809 00:51:47.982200 558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 00:51:47.982277 558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 00:51:47.982364 558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 00:51:47.982435 558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 00:51:47.982510 558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 00:51:47.992199 558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.28.92.148:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.28.92.190:33387,127.28.92.189:39303,127.28.92.188:39399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/krb5kdc/kudu_127.28.92.188.keytab
--principal=kudu/127.28.92.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.28.92.188:39399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.28.92.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 23:55:54 UTC on ccycloud.quasar-bjxnky.root.comops.site
build id 4575725
ASAN enabled
I20260809 00:51:47.993448 558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 00:51:47.994771 558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 00:51:48.004042 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 3
I20260809 00:51:48.005340 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.004709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43694)
0809 00:51:48.004940 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.005116 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260809 00:51:48.005961 570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:48.005971 572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 00:51:48.006235 569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 00:51:48.006614 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.006204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43702)
0809 00:51:48.006387 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.006470 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260809 00:51:48.006938 436 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.28.92.188:39399: Network error: Client connection negotiation failed: client connection to 127.28.92.188:39399: connect: Connection refused (error 111)
I20260809 00:51:48.007671 558 server_base.cc:1034] running on GCE node
I20260809 00:51:48.008456 558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 00:51:48.009879 558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 00:51:48.011106 558 hybrid_clock.cc:648] HybridClock initialized: now 1786236708011037 us; error 45 us; skew 500 ppm
I20260809 00:51:48.011432 558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 00:51:48.014711 558 init.cc:377] Logged in from keytab as kudu/127.28.92.188@KRBTEST.COM (short username kudu)
I20260809 00:51:48.016286 558 webserver.cc:460] Webserver started at http://127.28.92.188:39045/ using document root <none> and password file <none>
I20260809 00:51:48.016995 558 fs_manager.cc:359] Metadata directory not provided
I20260809 00:51:48.017112 558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 00:51:48.017437 558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 00:51:48.020533 558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data/instance:
uuid: "0beee4b6c1a946158c6fedead0a6b614"
format_stamp: "Formatted at 2026-08-09 00:51:48 on dist-test-slave-t7g5"
server_key: "efc8ea65033216a29a5666a1ecb0c39c"
server_key_iv: "fcfd4cc3b7d943842d3e7e20cff9f4f2"
server_key_version: "encryptionkey@0"
I20260809 00:51:48.021335 558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal/instance:
uuid: "0beee4b6c1a946158c6fedead0a6b614"
format_stamp: "Formatted at 2026-08-09 00:51:48 on dist-test-slave-t7g5"
server_key: "efc8ea65033216a29a5666a1ecb0c39c"
server_key_iv: "fcfd4cc3b7d943842d3e7e20cff9f4f2"
server_key_version: "encryptionkey@0"
I20260809 00:51:48.026654 558 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 00:51:48.030033 581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 00:51:48.031272 558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260809 00:51:48.031445 558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data,/tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal
uuid: "0beee4b6c1a946158c6fedead0a6b614"
format_stamp: "Formatted at 2026-08-09 00:51:48 on dist-test-slave-t7g5"
server_key: "efc8ea65033216a29a5666a1ecb0c39c"
server_key_iv: "fcfd4cc3b7d943842d3e7e20cff9f4f2"
server_key_version: "encryptionkey@0"
I20260809 00:51:48.031637 558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 00:51:48.047170 558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 00:51:48.051429 558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 00:51:48.051679 558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 00:51:48.069408 558 rpc_server.cc:307] RPC server started. Bound to: 127.28.92.188:39399
I20260809 00:51:48.069427 660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.28.92.188:39399 every 8 connection(s)
I20260809 00:51:48.070748 558 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/data/info.pb
I20260809 00:51:48.074271 661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 00:51:48.078549 29042 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu as pid 558
I20260809 00:51:48.078716 29042 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksLdMAp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786236336094448-29042-0/minicluster-data/master-2/wal/instance
I20260809 00:51:48.079109 29042 external_mini_cluster.cc:1428] Setting key c5e2c04f29183c88b07c4c8bc69ae9b6
I20260809 00:51:48.080968 661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:51:48.098344 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.083450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54882 (local address 127.28.92.190:33387)
0809 00:51:48.083656 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.083662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.084335 (+ 673us) server_negotiation.cc:407] Connection header received
0809 00:51:48.084586 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.084591 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.084652 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.084732 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.086009 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.086729 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.088144 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.088576 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.088686 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.091915 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.091920 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.091923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.091958 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.095034 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.095831 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.095837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.095842 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.096023 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.096470 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.096473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.096475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.096777 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.096923 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.097725 (+ 802us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.097964 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 00:51:48.099416 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.080765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43714 (local address 127.28.92.188:39399)
0809 00:51:48.081493 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.081504 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.081547 (+ 43us) server_negotiation.cc:407] Connection header received
0809 00:51:48.083332 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.083356 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.083796 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.084147 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.085572 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.086836 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.088072 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.088570 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.088724 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.092627 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.092638 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.092655 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.092697 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.095930 (+ 3233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.096723 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.096732 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.096735 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.096882 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.097253 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.097255 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.097257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.097623 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.097924 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.098515 (+ 591us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.098750 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":520,"thread_start_us":320,"threads_started":1}
I20260809 00:51:48.099448 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.083464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.190:33387 (local address 127.0.0.1:54882)
0809 00:51:48.084198 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.084246 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:48.084458 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:48.084810 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:48.084816 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:48.085407 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:48.085851 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.085866 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.086886 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.086890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.088008 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.088020 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.088796 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.088804 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.088938 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.089556 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:48.089577 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:48.091727 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:48.095156 (+ 3429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.095166 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.095182 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.095714 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.096128 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.096132 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.096135 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.096365 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.096901 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:48.096907 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:48.097331 (+ 424us) client_negotiation.cc:769] Sending connection context
0809 00:51:48.097573 (+ 242us) client_negotiation.cc:240] Negotiation successful
0809 00:51:48.098079 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":344,"threads_started":1}
I20260809 00:51:48.101256 661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.190@KRBTEST.COM
I20260809 00:51:48.114459 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.102046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.189:39303 (local address 127.0.0.1:46046)
0809 00:51:48.102203 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.102223 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:48.102315 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:48.102789 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:48.102794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:48.103151 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:48.103290 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.103298 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.104250 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.104255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.105106 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.105117 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.105802 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.105808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.105997 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.106559 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:48.106581 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:48.108979 (+ 2398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:48.112163 (+ 3184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.112169 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.112174 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.112654 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.113016 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.113021 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.113025 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.113203 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.113696 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:48.113701 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:48.113850 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 00:51:48.113965 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 00:51:48.114158 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 00:51:48.114603 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.102342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46046 (local address 127.28.92.189:39303)
0809 00:51:48.102525 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.102530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.102546 (+ 16us) server_negotiation.cc:407] Connection header received
0809 00:51:48.102596 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.102600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.102657 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.102746 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.103438 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.104116 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.105235 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.105634 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.105792 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.109163 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.109168 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.109172 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.109205 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.112029 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.112763 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.112767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.112769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.112908 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.113294 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.113296 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.113298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.113565 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.113722 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.114085 (+ 363us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.114311 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 00:51:48.115664 661 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } has no permanent_uuid. Determining permanent_uuid...
I20260809 00:51:48.117018 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.102217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54896 (local address 127.28.92.190:33387)
0809 00:51:48.102551 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.102557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.102573 (+ 16us) server_negotiation.cc:407] Connection header received
0809 00:51:48.102717 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.102722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.102785 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.102856 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.103936 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.104644 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.105817 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.106249 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.106366 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.110833 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.110838 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.110841 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.110871 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.113588 (+ 2717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.114334 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.114340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.114343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.114503 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.115106 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.115111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.115113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.115519 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.115799 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.116500 (+ 701us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.116723 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226}
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236708, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.188@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.28.92.189@KRBTEST.COM
I20260809 00:51:48.129001 665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.116516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43722)
0809 00:51:48.116659 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.116676 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:48.116779 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:48.117066 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:48.117071 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:48.117519 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:48.117721 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.117733 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.118752 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.118757 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.120026 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.120041 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.120817 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.120822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.121002 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.121534 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:48.121556 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:48.124082 (+ 2526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:48.126713 (+ 2631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.126716 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.126719 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.127073 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.127435 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.127449 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.127453 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.127622 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.128096 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:48.128101 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:48.128225 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 00:51:48.128352 (+ 127us) client_negotiation.cc:240] Negotiation successful
0809 00:51:48.128662 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 00:51:48.129223 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.116443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43722 (local address 127.28.92.188:39399)
0809 00:51:48.116607 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.116612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.116744 (+ 132us) server_negotiation.cc:407] Connection header received
0809 00:51:48.116870 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.116873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.116938 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.117023 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.117847 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.118638 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.120173 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.120676 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.120801 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.124255 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.124262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.124267 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.124299 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.126586 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.127200 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.127203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.127206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.127321 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.127723 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.127726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.127728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.127988 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.128116 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.128461 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.128859 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":144,"server-negotiator.queue_time_us":46}
I20260809 00:51:48.133751 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.118634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46058 (local address 127.28.92.189:39303)
0809 00:51:48.118800 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.118805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.118821 (+ 16us) server_negotiation.cc:407] Connection header received
0809 00:51:48.118916 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.118919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.118979 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.119047 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.120467 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.121376 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.123038 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.123667 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.123786 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.128113 (+ 4327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.128118 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.128121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.128153 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.131298 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.131974 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.131979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.131983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.132146 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.132467 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.132472 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.132475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.132810 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.133076 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.133193 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.133411 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:51:48.135164 661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: Bootstrap starting.
I20260809 00:51:48.138294 29042 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 00:51:48.138610 661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:48.139845 661 log.cc:824] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:48.142973 661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: No bootstrap required, opened a new log
I20260809 00:51:48.141269 395 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "75f3448b89234aa3ad5a1976c42f2a5e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54896
I20260809 00:51:48.153497 661 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.153931 661 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0beee4b6c1a946158c6fedead0a6b614, State: Initialized, Role: FOLLOWER
I20260809 00:51:48.154448 661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.155354 667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.155696 667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.156623 661 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 00:51:48.165493 686 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 00:51:48.165611 686 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 00:51:48.163693 558 master_runner.cc:186] Error getting master registration for 127.28.92.190:33387: OK, instance_id { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" instance_seqno: 1786236707047910 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 00:51:48.174451 558 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 00:51:48.184141 436 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 4
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236706, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.190@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:51:48.208668 439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.184893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43726)
0809 00:51:48.185100 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.185122 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:48.185260 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:48.185624 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:48.185629 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:48.186203 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:48.186411 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.186425 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.187860 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.187866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.189321 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.189339 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.190354 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.190361 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.190569 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.191253 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:48.191277 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:48.201305 (+ 10028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:48.205567 (+ 4262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.205574 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.205579 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.206282 (+ 703us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.206706 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.206711 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.206715 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.206892 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.207651 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:48.207656 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:48.207826 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 00:51:48.207971 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 00:51:48.208275 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 00:51:48.208726 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.184940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43726 (local address 127.28.92.188:39399)
0809 00:51:48.185130 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.185136 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.185216 (+ 80us) server_negotiation.cc:407] Connection header received
0809 00:51:48.185378 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.185384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.185479 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.185603 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.186577 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.187715 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.189486 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.190190 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.190332 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.201586 (+ 11254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.201593 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.201598 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.201667 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.205386 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.206418 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.206425 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.206428 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.206588 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.207028 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.207033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.207037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.207522 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.207706 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.208113 (+ 407us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.208363 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 00:51:48.213379 436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e: Bootstrap starting.
I20260809 00:51:48.216928 436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:48.218221 436 log.cc:824] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:48.220867 436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e: No bootstrap required, opened a new log
I20260809 00:51:48.228206 436 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.228621 436 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75f3448b89234aa3ad5a1976c42f2a5e, State: Initialized, Role: FOLLOWER
I20260809 00:51:48.229053 436 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.229993 691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.230430 691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.231225 436 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:48.231386 395 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 00:51:48.231607 395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:48.235146 395 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.237143 395 leader_election.cc:288] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [CANDIDATE]: Term 1 election: Requested vote from peers 596912e50a994107b82dc51cf368a45b (127.28.92.189:39303), 0beee4b6c1a946158c6fedead0a6b614 (127.28.92.188:39399)
I20260809 00:51:48.237517 621 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0beee4b6c1a946158c6fedead0a6b614"
I20260809 00:51:48.238050 621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:48.240528 621 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75f3448b89234aa3ad5a1976c42f2a5e in term 1.
I20260809 00:51:48.241127 361 leader_election.cc:302] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0beee4b6c1a946158c6fedead0a6b614, 75f3448b89234aa3ad5a1976c42f2a5e; no voters:
I20260809 00:51:48.241578 691 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 00:51:48.248461 691 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [term 1 LEADER]: Becoming Leader. State: Replica: 75f3448b89234aa3ad5a1976c42f2a5e, State: Running, Role: LEADER
I20260809 00:51:48.249115 691 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.263556 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75f3448b89234aa3ad5a1976c42f2a5e. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.264204 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:48.274552 713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 00:51:48.277400 546 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } attempt: 5
W20260809 00:51:48.287513 366 tablet.cc:2369] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:51:48.294752 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.264464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54904 (local address 127.28.92.190:33387)
0809 00:51:48.264637 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.264643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.271414 (+ 6771us) server_negotiation.cc:407] Connection header received
0809 00:51:48.272320 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.272328 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.272417 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.272488 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.275653 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.276940 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.279105 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.279862 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.279974 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.283787 (+ 3813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.283795 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.283801 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.283843 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.288365 (+ 4522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.289536 (+ 1171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.289544 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.289548 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.289964 (+ 416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.290697 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.290703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.290706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.291375 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.293240 (+ 1865us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.293584 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.294052 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260809 00:51:48.303858 589 tablet.cc:2369] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 00:51:48.306170 713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 00:51:48 dist-test-slave-t7g5 krb5kdc[311](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786236707, etypes {rep=17 tkt=17 ses=17}, kudu/127.28.92.189@KRBTEST.COM for kudu/127.28.92.188@KRBTEST.COM
I20260809 00:51:48.307029 664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.262232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43728 (local address 127.28.92.188:39399)
0809 00:51:48.262413 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.262420 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.270095 (+ 7675us) server_negotiation.cc:407] Connection header received
0809 00:51:48.271416 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.271423 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.271544 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.271619 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.275995 (+ 4376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.277043 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.282008 (+ 4965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.282739 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.282835 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.292620 (+ 9785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.292627 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.292633 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.292676 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.296266 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.302842 (+ 6576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.302846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.302850 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.303004 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.304102 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.304106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.304109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.304474 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.304725 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.306426 (+ 1701us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.306682 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:51:48.308467 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.260625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46064 (local address 127.28.92.189:39303)
0809 00:51:48.260823 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.260829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.269576 (+ 8747us) server_negotiation.cc:407] Connection header received
0809 00:51:48.270805 (+ 1229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.270812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.270903 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.270981 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.277712 (+ 6731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.278752 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.284132 (+ 5380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.285073 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.285175 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.298468 (+ 13293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.298476 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.298481 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.298526 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.302040 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.303480 (+ 1440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.303486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.303489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.303664 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.305213 (+ 1549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.305218 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.305221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.305616 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.305876 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.307878 (+ 2002us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.308141 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:51:48.322299 549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.278046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.28.92.188:39399 (local address 127.0.0.1:43742)
0809 00:51:48.278396 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 00:51:48.278414 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 00:51:48.278517 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 00:51:48.296420 (+ 17903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 00:51:48.296425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 00:51:48.296974 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 00:51:48.297194 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.297207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.299052 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.299058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.300626 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 00:51:48.300643 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.302510 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.302517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 00:51:48.302740 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.303416 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 00:51:48.303443 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 00:51:48.309771 (+ 6328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 00:51:48.317677 (+ 7906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.317685 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.317689 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.318540 (+ 851us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.319295 (+ 755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 00:51:48.319322 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 00:51:48.319326 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 00:51:48.319583 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 00:51:48.320732 (+ 1149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 00:51:48.320738 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 00:51:48.320995 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 00:51:48.321206 (+ 211us) client_negotiation.cc:240] Negotiation successful
0809 00:51:48.321706 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232}
I20260809 00:51:48.327970 718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.278707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43742 (local address 127.28.92.188:39399)
0809 00:51:48.296070 (+ 17363us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.296076 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.296102 (+ 26us) server_negotiation.cc:407] Connection header received
0809 00:51:48.296156 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.296161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.296241 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.296348 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.297752 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.298895 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.301720 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.302350 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.302469 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.313810 (+ 11341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 00:51:48.313817 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 00:51:48.313822 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 00:51:48.313860 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 00:51:48.317492 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.318757 (+ 1265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.318763 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.318791 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.319088 (+ 297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 00:51:48.319805 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 00:51:48.319811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 00:51:48.319815 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 00:51:48.320544 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 00:51:48.323061 (+ 2517us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.323310 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.327318 (+ 4008us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17196,"thread_start_us":17827,"threads_started":1}
I20260809 00:51:48.331959 621 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [term 1 FOLLOWER]: Refusing update from remote peer 75f3448b89234aa3ad5a1976c42f2a5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:51:48.332995 699 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:51:48.333981 546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: Bootstrap starting.
I20260809 00:51:48.337917 546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: Neither blocks nor log segments found. Creating new log.
I20260809 00:51:48.339288 546 log.cc:824] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: Log is configured to *not* fsync() on all Append() calls
I20260809 00:51:48.348663 546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: No bootstrap required, opened a new log
I20260809 00:51:48.370391 546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.370844 546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596912e50a994107b82dc51cf368a45b, State: Initialized, Role: FOLLOWER
I20260809 00:51:48.371395 546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } }
I20260809 00:51:48.373231 667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75f3448b89234aa3ad5a1976c42f2a5e. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.373566 667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.376085 726 mvcc.cc:205] Tried to move back new op lower bound from 7316425557312000000 to 7316425556994605056. Current Snapshot: MvccSnapshot[applied={T|T < 7316425557312000000}]
I20260809 00:51:48.376325 733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.377142 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.377398 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:48.377748 728 mvcc.cc:205] Tried to move back new op lower bound from 7316425557312000000 to 7316425556994605056. Current Snapshot: MvccSnapshot[applied={T|T < 7316425557312000000}]
I20260809 00:51:48.382091 733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.382023 667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.379101 516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "596912e50a994107b82dc51cf368a45b"
I20260809 00:51:48.382249 667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.379401 514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [term 0 FOLLOWER]: Advancing to term 1
I20260809 00:51:48.385128 514 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [term 1 FOLLOWER]: Refusing update from remote peer 75f3448b89234aa3ad5a1976c42f2a5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 00:51:48.369935 337 master_runner.cc:186] Error getting master registration for 127.28.92.189:39303: OK, instance_id { permanent_uuid: "596912e50a994107b82dc51cf368a45b" instance_seqno: 1786236707555811 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 00:51:48.386147 337 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 00:51:48.387058 691 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 00:51:48.388473 516 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75f3448b89234aa3ad5a1976c42f2a5e in term 1.
I20260809 00:51:48.379035 546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 00:51:48.390758 713 catalog_manager.cc:1347] Generated new cluster ID: 3f2c2241488e469bb54d8edc3e62ee78
I20260809 00:51:48.390851 713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 00:51:48.410615 742 mvcc.cc:205] Tried to move back new op lower bound from 7316425557312000000 to 7316425556994605056. Current Snapshot: MvccSnapshot[applied={T|T < 7316425557312000000}]
I20260809 00:51:48.416651 733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.417156 733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.417245 737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75f3448b89234aa3ad5a1976c42f2a5e. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.417752 737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b [sys.catalog]: This master's current role is: FOLLOWER
I20260809 00:51:48.418347 699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75f3448b89234aa3ad5a1976c42f2a5e" member_type: VOTER last_known_addr { host: "127.28.92.190" port: 33387 } } peers { permanent_uuid: "596912e50a994107b82dc51cf368a45b" member_type: VOTER last_known_addr { host: "127.28.92.189" port: 39303 } } peers { permanent_uuid: "0beee4b6c1a946158c6fedead0a6b614" member_type: VOTER last_known_addr { host: "127.28.92.188" port: 39399 } } }
I20260809 00:51:48.418643 699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e [sys.catalog]: This master's current role is: LEADER
I20260809 00:51:48.424489 713 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 00:51:48.426661 713 catalog_manager.cc:1504] Loading token signing keys...
I20260809 00:51:48.448864 713 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75f3448b89234aa3ad5a1976c42f2a5e: Generated new TSK 0
I20260809 00:51:48.450062 713 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 00:51:48.467033 758 catalog_manager.cc:1259] Loaded cluster ID: 3f2c2241488e469bb54d8edc3e62ee78
I20260809 00:51:48.467240 758 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: loading cluster ID for follower catalog manager: success
I20260809 00:51:48.470860 758 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: acquiring CA information for follower catalog manager: success
I20260809 00:51:48.473295 758 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 596912e50a994107b82dc51cf368a45b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 00:51:48.605049 555 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.584496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46078 (local address 127.28.92.189:39303)
0809 00:51:48.584733 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.584740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.602003 (+ 17263us) server_negotiation.cc:407] Connection header received
0809 00:51:48.603296 (+ 1293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.603303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.603395 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.603493 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.604809 (+ 1316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46078: BlockingRecv error: recv got EOF from 127.0.0.1:46078 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 00:51:48.611055 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.586370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43746 (local address 127.28.92.188:39399)
0809 00:51:48.586561 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.586568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.607695 (+ 21127us) server_negotiation.cc:407] Connection header received
0809 00:51:48.609617 (+ 1922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.609624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.609753 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.609831 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.610816 (+ 985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43746: BlockingRecv error: recv got EOF from 127.0.0.1:43746 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 00:51:48.613199 441 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.600209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54906 (local address 127.28.92.190:33387)
0809 00:51:48.600449 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.600455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.609152 (+ 8697us) server_negotiation.cc:407] Connection header received
0809 00:51:48.611746 (+ 2594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.611752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.611846 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.611920 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.612959 (+ 1039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54906: BlockingRecv error: recv got EOF from 127.0.0.1:54906 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 00:51:48.663597 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.647778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46090 (local address 127.28.92.189:39303)
0809 00:51:48.647985 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.647991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.655377 (+ 7386us) server_negotiation.cc:407] Connection header received
0809 00:51:48.656006 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.656012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.656258 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.656403 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.657175 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.658360 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.660422 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.661086 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.661181 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.662013 (+ 832us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.662725 (+ 712us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.662859 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.663147 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.663254 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260809 00:51:48.708112 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.697476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43762 (local address 127.28.92.188:39399)
0809 00:51:48.697721 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.697728 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.706243 (+ 8515us) server_negotiation.cc:407] Connection header received
0809 00:51:48.706474 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.706480 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.706615 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.706726 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.707833 (+ 1107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43762: BlockingRecv error: recv got EOF from 127.0.0.1:43762 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 00:51:48.760870 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.746151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46094 (local address 127.28.92.189:39303)
0809 00:51:48.746337 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.746343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.753754 (+ 7411us) server_negotiation.cc:407] Connection header received
0809 00:51:48.754331 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.754338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.754435 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.754506 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.755267 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.756463 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.758584 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.759274 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.759366 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.759998 (+ 632us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.760171 (+ 173us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.760228 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.760456 (+ 228us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.760548 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260809 00:51:48.782011 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.779793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43766 (local address 127.28.92.188:39399)
0809 00:51:48.779988 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.779995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.780527 (+ 532us) server_negotiation.cc:407] Connection header received
0809 00:51:48.780709 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.780715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.780796 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.780883 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.781776 (+ 893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43766: BlockingRecv error: recv got EOF from 127.0.0.1:43766 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 00:51:48.792600 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.786928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46096 (local address 127.28.92.189:39303)
0809 00:51:48.787132 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.787139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.787651 (+ 512us) server_negotiation.cc:407] Connection header received
0809 00:51:48.787815 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.787820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.787918 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.788001 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.788434 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.789330 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.790874 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.791307 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.791421 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.791827 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.791956 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.792031 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.792185 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.792268 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 00:51:48.807606 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.803099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43774 (local address 127.28.92.188:39399)
0809 00:51:48.803297 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.803304 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.806192 (+ 2888us) server_negotiation.cc:407] Connection header received
0809 00:51:48.806382 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.806388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.806487 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.806571 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.807353 (+ 782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43774: BlockingRecv error: recv got EOF from 127.0.0.1:43774 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 00:51:48.820228 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.814845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46110 (local address 127.28.92.189:39303)
0809 00:51:48.815046 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.815052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.815519 (+ 467us) server_negotiation.cc:407] Connection header received
0809 00:51:48.815698 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.815704 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.815792 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.815869 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.816325 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.817163 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.818599 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.819072 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.819182 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.819578 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.819682 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.819762 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.819891 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.819975 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 00:51:48.833158 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.830981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43786 (local address 127.28.92.188:39399)
0809 00:51:48.831244 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.831264 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.831874 (+ 610us) server_negotiation.cc:407] Connection header received
0809 00:51:48.832053 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.832059 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.832135 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.832217 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.832977 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43786: BlockingRecv error: recv got EOF from 127.0.0.1:43786 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
I20260809 00:51:48.850690 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.845231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46124 (local address 127.28.92.189:39303)
0809 00:51:48.845431 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.845438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.845987 (+ 549us) server_negotiation.cc:407] Connection header received
0809 00:51:48.846178 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.846182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.846250 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.846327 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.846913 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.847628 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.848937 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.849385 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.849506 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.849962 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.850071 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.850157 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.850279 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.850367 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260809 00:51:48.864924 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.862928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43794 (local address 127.28.92.188:39399)
0809 00:51:48.863130 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.863137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.863630 (+ 493us) server_negotiation.cc:407] Connection header received
0809 00:51:48.863803 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.863809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.863889 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.863982 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.864742 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43794: BlockingRecv error: recv got EOF from 127.0.0.1:43794 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 00:51:48.890476 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.884767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46138 (local address 127.28.92.189:39303)
0809 00:51:48.884973 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.884980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.885478 (+ 498us) server_negotiation.cc:407] Connection header received
0809 00:51:48.885699 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.885705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.885790 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.885868 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.886296 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.887272 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.888594 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.889054 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.889167 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.889696 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.889822 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.889928 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.890114 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.890204 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 00:51:48.903523 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.901427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43806 (local address 127.28.92.188:39399)
0809 00:51:48.901642 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.901682 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.902176 (+ 494us) server_negotiation.cc:407] Connection header received
0809 00:51:48.902348 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.902354 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.902435 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.902521 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.903282 (+ 761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43806: BlockingRecv error: recv got EOF from 127.0.0.1:43806 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260809 00:51:48.944669 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:48.938739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46140 (local address 127.28.92.189:39303)
0809 00:51:48.938973 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.938979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.939232 (+ 253us) server_negotiation.cc:407] Connection header received
0809 00:51:48.939396 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.939402 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.939529 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.939656 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:48.940016 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.941143 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.942564 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:48.943294 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:48.943446 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:48.943823 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:48.943961 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:48.944069 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:48.944293 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 00:51:48.944359 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260809 00:51:48.952667 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:48.950728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43812 (local address 127.28.92.188:39399)
0809 00:51:48.950929 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:48.950936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:48.950956 (+ 20us) server_negotiation.cc:407] Connection header received
0809 00:51:48.951184 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:48.951190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:48.951289 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:48.951378 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:48.952431 (+ 1053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43812: BlockingRecv error: recv got EOF from 127.0.0.1:43812 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 00:51:49.025132 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:49.020010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46148 (local address 127.28.92.189:39303)
0809 00:51:49.020227 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.020234 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.020495 (+ 261us) server_negotiation.cc:407] Connection header received
0809 00:51:49.020695 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.020699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.020770 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.020864 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:49.021302 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.022154 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.023464 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.023888 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.024002 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:49.024440 (+ 438us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:49.024551 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:49.024627 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:49.024783 (+ 156us) server_negotiation.cc:299] Negotiation successful
0809 00:51:49.024876 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 00:51:49.032344 718 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 00:51:49.030459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43828 (local address 127.28.92.188:39399)
0809 00:51:49.030705 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.030711 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.030981 (+ 270us) server_negotiation.cc:407] Connection header received
0809 00:51:49.031149 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.031171 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.031262 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.031361 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 00:51:49.032176 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43828: BlockingRecv error: recv got EOF from 127.0.0.1:43828 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 00:51:49.167982 686 catalog_manager.cc:1259] Loaded cluster ID: 3f2c2241488e469bb54d8edc3e62ee78
I20260809 00:51:49.168110 686 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: loading cluster ID for follower catalog manager: success
I20260809 00:51:49.169113 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:49.163844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46160 (local address 127.28.92.189:39303)
0809 00:51:49.164111 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.164118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.164321 (+ 203us) server_negotiation.cc:407] Connection header received
0809 00:51:49.164482 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.164486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.164561 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.164642 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:49.164978 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.165704 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.167453 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.167838 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.167940 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:49.168444 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:49.168556 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:49.168621 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:49.168789 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 00:51:49.168854 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260809 00:51:49.171518 686 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: acquiring CA information for follower catalog manager: success
I20260809 00:51:49.173530 686 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0beee4b6c1a946158c6fedead0a6b614: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 00:51:49.179881 718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:49.174851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43838 (local address 127.28.92.188:39399)
0809 00:51:49.175009 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.175014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.175365 (+ 351us) server_negotiation.cc:407] Connection header received
0809 00:51:49.175524 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.175528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.175637 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.175728 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:49.176025 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.176711 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.177939 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.178328 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.178415 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:49.178810 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:49.179276 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:49.179410 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:49.179517 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 00:51:49.179595 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 00:51:49.192788 718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:49.185870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43850 (local address 127.28.92.188:39399)
0809 00:51:49.186069 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.186074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.187609 (+ 1535us) server_negotiation.cc:407] Connection header received
0809 00:51:49.187676 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.187681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.187753 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.187844 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:49.188365 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.189344 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.191082 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.191551 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.191661 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:49.192086 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:49.192219 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:49.192310 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:49.192463 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 00:51:49.192539 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 00:51:49.193463 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:49.185483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46164 (local address 127.28.92.189:39303)
0809 00:51:49.185709 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.185715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.187062 (+ 1347us) server_negotiation.cc:407] Connection header received
0809 00:51:49.187275 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.187281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.187376 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.187468 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:49.188048 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.189241 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.191457 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.191965 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.192072 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:49.192612 (+ 540us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:49.192731 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:49.192791 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:49.193146 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 00:51:49.193224 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 00:51:49.194257 946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 00:51:49.185351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54914 (local address 127.28.92.190:33387)
0809 00:51:49.186097 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0809 00:51:49.186103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 00:51:49.187907 (+ 1804us) server_negotiation.cc:407] Connection header received
0809 00:51:49.188209 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 00:51:49.188214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 00:51:49.188423 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 00:51:49.188573 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 00:51:49.189049 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.190059 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.192096 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 00:51:49.192622 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 00:51:49.192739 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 00:51:49.193238 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 00:51:49.193572 (+ 334us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 00:51:49.193708 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 00:51:49.193879 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 00:51:49.193973 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":618,"thread_start_us":484,"threads_started":1}
I20260809 00:51:49.198107 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 337
I20260809 00:51:49.199268 429 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:49.308634 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 337
I20260809 00:51:49.339555 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 448
I20260809 00:51:49.340626 541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:49.447151 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 448
I20260809 00:51:49.476748 29042 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu pid 558
I20260809 00:51:49.477908 655 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 00:51:49.583729 29042 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksLdMAp/build/asan/bin/kudu with pid 558
2026-08-09T00:51:49Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4554 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9164 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (373414 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST